-- Logs begin at Thu 2022-07-07 09:43:04 UTC, end at Thu 2022-07-07 10:44:04 UTC. -- Jul 07 10:17:22.070250 dv-cinder-822821-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 07 10:17:22.079611 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 07 10:17:22.081586 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 7 10:17:22 2022] *** Jul 07 10:17:22.081586 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 07 10:17:22.081586 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 07 10:17:22.081586 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: nodename: dv-cinder-822821-4-iscsi Jul 07 10:17:22.081586 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: machine: x86_64 Jul 07 10:17:22.081586 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: clock source: unix Jul 07 10:17:22.081586 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: pcre jit disabled Jul 07 10:17:22.081586 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: detected number of CPU cores: 4 Jul 07 10:17:22.081586 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: current working directory: / Jul 07 10:17:22.081586 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: detected binary path: /usr/bin/uwsgi-core Jul 07 10:17:22.082304 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: your processes number limit is 47680 Jul 07 10:17:22.082304 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: your memory page size is 4096 bytes Jul 07 10:17:22.082304 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: detected max file descriptor number: 2048 Jul 07 10:17:22.082304 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: lock engine: pthread robust mutexes Jul 07 10:17:22.082304 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: thunder lock: enabled Jul 07 10:17:22.082304 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 07 10:17:22.082304 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 07 10:17:22.124720 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: Python main interpreter initialized at 0x563256f069c0 Jul 07 10:17:22.124720 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: python threads support enabled Jul 07 10:17:22.124720 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: your server socket listen backlog is limited to 100 connections Jul 07 10:17:22.124720 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: your mercy for graceful operations on workers is 90 seconds Jul 07 10:17:22.125026 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: mapped 403077 bytes (393 KB) for 2 cores Jul 07 10:17:22.125108 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: *** Operational MODE: preforking *** Jul 07 10:17:22.125361 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: *** uWSGI is running in multiple interpreter mode *** Jul 07 10:17:22.125361 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: spawned uWSGI master process (pid: 103122) Jul 07 10:17:22.125542 dv-cinder-822821-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 07 10:17:22.126065 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: spawned uWSGI worker 1 (pid: 103123, cores: 1) Jul 07 10:17:22.127181 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: spawned uWSGI worker 2 (pid: 103124, cores: 1) Jul 07 10:17:22.127181 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 07 10:17:22.776839 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 07 10:17:22.778959 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 07 10:17:23.883652 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 10:17:23.883652 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: from cryptography.utils import int_from_bytes Jul 07 10:17:23.884271 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 10:17:23.884271 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: from cryptography.utils import int_from_bytes Jul 07 10:17:23.885095 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 10:17:23.885095 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: from cryptography.utils import int_from_bytes Jul 07 10:17:23.885510 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 10:17:23.885510 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: from cryptography.utils import int_from_bytes Jul 07 10:17:26.358598 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 07 10:17:26.359209 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 07 10:17:26.359357 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 07 10:17:26.359718 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 07 10:17:26.359997 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 07 10:17:26.360379 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.360479 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 07 10:17:26.360822 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 07 10:17:26.360902 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.360992 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.361184 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 07 10:17:26.361319 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.361550 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 07 10:17:26.361687 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.362354 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 07 10:17:26.362452 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.362745 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.362844 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.363069 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.363177 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.363392 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.363487 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.363647 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.363773 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.363989 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.364085 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.364310 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822821-4-iscsi {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.364405 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.364629 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.364721 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.364933 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.365021 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.365241 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.365339 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.365541 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.365626 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.365844 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.365938 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.366162 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.366250 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822821-4-iscsi {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.366464 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.366557 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.366773 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.366962 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.367072 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.367394 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.367517 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.367697 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.367833 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.368058 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.368180 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.368369 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.368481 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.368719 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.368872 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.369072 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.369199 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.369381 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.369480 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.369684 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.369784 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.370007 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.370092 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.370320 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.370413 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.370707 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.370798 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822821-4-iscsi {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.371019 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.371103 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.371332 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.371490 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.371627 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.371710 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.371981 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.372076 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.372351 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.372438 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822821-4-iscsi {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.372659 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.372748 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.372975 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.373095 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.373292 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.373387 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.373591 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.373693 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.373915 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.374008 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.374232 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.374358 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.374565 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.374653 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.374850 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.374938 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.375149 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.375235 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.375456 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.375550 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.375778 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.375884 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.376098 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.376191 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.376402 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.376513 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.376703 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.376818 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.376952 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.377128 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.377290 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.377462 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.377619 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.377786 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.377937 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.378094 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.378256 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.378406 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.378518 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.378659 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.378805 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.378969 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.379058 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.379296 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.379393 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.379617 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.379716 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.379957 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.380048 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.380229 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.380314 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.380482 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.380578 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.380803 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.380899 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.381126 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.381220 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.381425 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.381523 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.381729 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.381818 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.382036 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.382127 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.382344 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.382437 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.382649 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.382733 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.382953 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.383038 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.383260 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.383400 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.383569 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.383655 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.383908 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.383997 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.384215 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.384304 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.384538 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.384624 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.384851 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.384954 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.385154 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.385239 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.385469 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.385560 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.385786 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.385886 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.386092 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.386179 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.386395 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.386480 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.386698 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.386792 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.387017 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.387104 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.387343 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.387435 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.387643 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.387737 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.387915 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.388012 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.388213 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.388301 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.388513 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.388601 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.388824 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.388911 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.389128 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.389222 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.389470 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.389569 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.389753 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.389839 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.390055 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.390140 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.390363 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.390450 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.390664 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.390750 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.390966 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.391052 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.391289 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.391380 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.391572 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.391669 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.391895 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.391998 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.392198 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.392286 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.392499 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.392592 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.392801 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.392896 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.393137 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.393225 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.393448 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.393533 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.393754 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.393849 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.394057 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.394144 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.394360 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.394459 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.394662 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.394762 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.394978 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.395064 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.395279 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.395364 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.395581 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.395680 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.395913 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.396001 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.396214 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.396310 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.396516 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.396616 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.396827 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.396913 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.397130 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.397223 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.397431 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.397526 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.397745 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.397843 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.398041 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.398134 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.398345 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.398445 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.398667 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.398754 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.398976 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.399063 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.399284 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.399386 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.399585 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.399682 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.399908 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.400008 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.400211 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.400299 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.400517 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.400603 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.400817 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.400916 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.401120 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.401216 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.401416 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.401502 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.401720 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.401804 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.402029 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.402120 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.402333 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.402427 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.402636 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.402720 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.402937 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.403023 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.403236 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.403320 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.403555 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.403654 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.403906 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.404012 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.404221 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.404306 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.404531 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.404625 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.404842 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.404927 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.405163 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:17:26.405248 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.405477 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.405571 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.405788 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.405880 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.406098 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.406184 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.406422 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.406516 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.406733 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.406818 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.407042 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.407128 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.407353 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.407441 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.407671 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.407777 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.408010 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.408097 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.408336 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.408431 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.409182 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.409277 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.409497 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.409680 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.409818 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.409954 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.410131 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.410238 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.410445 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.410533 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.410770 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.410858 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.411089 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.411184 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.411397 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.411531 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.411718 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.411852 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.412058 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.412145 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.412381 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.412480 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.412700 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.412785 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.413018 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.413106 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.413327 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.413489 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.413637 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.413724 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.413944 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.414063 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.414263 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.414384 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.414596 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.414712 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.414903 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.415034 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.415216 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.415350 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.415526 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.415663 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.415856 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.416013 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.416167 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.416339 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.416478 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.416676 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.416785 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.416992 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.417115 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.417312 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.417428 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.417629 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.417739 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.417945 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.418042 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.418259 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.418345 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.418574 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.418661 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.418889 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.418986 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.419226 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.419312 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.419539 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.419680 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.419847 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.420002 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.420149 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.420237 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.420454 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.420541 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.420754 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.420842 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.421070 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.421156 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.421385 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.421476 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.421687 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.421775 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.421992 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.422080 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.422298 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.422384 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.422602 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.422688 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.422907 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.422991 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.423211 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.423296 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.423513 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.423601 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.423843 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.423933 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.424726 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.424938 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.425030 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.425110 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.425331 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.425417 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.425638 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.425738 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.425940 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.426028 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.426260 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.426348 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.426564 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.426659 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.426865 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.426951 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.427174 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.427260 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.427482 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.427577 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.427809 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.427909 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.428371 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.428470 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.428675 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.428762 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.428992 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.429077 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.429299 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.429386 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.429606 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.429693 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.429936 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.430023 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.430263 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.430353 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.430565 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.430653 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.430893 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.430979 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.431217 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.431312 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.431531 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.431618 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.431850 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.431939 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.432160 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.432264 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.432463 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.432553 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.432764 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.432850 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.433065 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.433159 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.433369 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.433456 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.433667 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.433753 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.433967 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.434062 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.434266 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.434354 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.434565 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.434651 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.434865 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.434964 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.435182 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.435275 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.435487 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.435573 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.435804 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.435904 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.436107 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.436205 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.436406 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.436493 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.436710 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.436832 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.437016 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.437111 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.437341 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.437428 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.437655 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.437749 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.437960 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.438054 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.438267 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.438362 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.438572 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.438671 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.438882 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.438975 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.439190 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.439284 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.439502 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.439589 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.439869 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.439991 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.440182 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.440298 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.440500 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.440596 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.440812 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.440900 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.441128 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.441225 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.441436 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.441523 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.441751 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.441837 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.442055 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.442153 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.442367 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.442499 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.442667 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.442752 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.442977 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.443077 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.443297 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.443382 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.443609 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.443694 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.443953 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.444084 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.444267 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.444352 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.444573 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.444667 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.444885 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.444973 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.445191 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.445287 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.445501 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.445595 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.445811 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.445899 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.446121 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.446220 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.446438 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.446524 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.446747 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.446841 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.447062 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.447157 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.447370 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.447470 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.447683 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.447822 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.448014 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.448102 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.448331 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.448424 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.448630 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.448715 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.448942 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.449030 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.449264 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.449358 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.449577 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.449663 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.449885 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.449976 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.450194 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.450294 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.450513 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.450603 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.450825 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.450910 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.451130 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.451220 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.451437 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.451531 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.451737 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.451842 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.452058 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.452146 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.452365 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.452459 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.452678 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.452769 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.452986 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.453074 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.453294 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.453380 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.453595 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.453681 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.453906 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.453994 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.454211 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.454345 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.454515 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.454614 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.454816 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.454902 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.455125 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.455211 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.455996 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.456162 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.456310 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.456476 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.456633 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.456797 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.456956 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.457111 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.457261 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.457421 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.457564 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.457729 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.457885 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.458046 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.458193 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.458375 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.458494 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.458691 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.458797 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.459017 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.459105 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.459430 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.459721 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.459836 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.460051 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.460139 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.460364 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.460487 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.460682 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.460768 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.460994 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.461082 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.461307 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.461393 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.461618 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.461703 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.461923 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.462009 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.462243 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.462385 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.462555 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.462678 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.462863 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.462951 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.463171 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.463258 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.463481 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.463577 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.463810 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.463900 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.464121 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.464207 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.464435 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.464536 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.464742 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.464828 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.465050 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.465137 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.465360 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.465456 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.465666 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.465766 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.465981 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.466072 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.466299 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.466397 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.466616 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.466860 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.466947 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.467193 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.467288 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.467508 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.467607 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.467849 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.467952 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.468168 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.468263 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.468480 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.468566 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.468798 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.468883 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.469121 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.469220 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.469458 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.469686 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.469783 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.470026 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.470118 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.470346 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.470447 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.470648 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.470736 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.470978 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.471123 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.471327 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.471423 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.471633 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.471720 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.471960 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.472051 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.472270 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.472359 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.472574 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.472670 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.472876 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.472973 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.473178 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.473265 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.473482 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.473570 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.473794 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.473881 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.474095 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.474190 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.474407 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.474493 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.474708 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.474794 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.475027 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.475122 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.475332 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.475460 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.475630 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.475717 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.475955 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.476057 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.476257 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.476351 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.476572 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.476657 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.476879 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.476974 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.477196 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.477289 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.477504 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.477591 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.477829 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.477916 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.478133 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.478218 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.478436 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.478521 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.478743 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.478832 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.479046 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.479133 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.479348 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.479435 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.479651 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.479812 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.479982 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.480071 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.480289 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.480376 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.480591 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.480685 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.480907 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.481000 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.481215 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.481313 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.481522 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.481617 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.481831 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.481917 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.482131 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.482229 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.482438 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.482574 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.482739 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.482826 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.483050 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.483145 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.483352 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.483436 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.483652 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.483737 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.483976 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.484074 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.484284 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.484371 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.484590 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.484678 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.484890 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.484978 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.485197 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.485282 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.485497 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.485589 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.485810 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.485898 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.486111 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.486204 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.486410 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.486497 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.487223 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.487330 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.487535 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.487628 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.487868 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.487957 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.488170 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.488257 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.488480 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.488573 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.488787 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.488884 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.489087 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.489172 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.489389 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.489484 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.489693 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.489787 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.489994 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.490079 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.490294 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.490381 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.490601 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.490701 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.490905 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.490990 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.491219 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.491311 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.491526 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.491621 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.491853 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.491941 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.492155 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.492248 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.492461 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.492548 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.492764 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.492860 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.493067 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.493152 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.493369 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.493457 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.493670 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.493763 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.493970 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.494064 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.494272 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.494359 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.494572 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.494702 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.494879 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.494972 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.495183 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.495270 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.495482 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.495570 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.495804 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.495912 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.496107 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.496196 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.496412 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.496497 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.496718 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.496813 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.497027 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.497113 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.497335 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.497421 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.497660 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.497755 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.497973 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.498059 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.498279 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.498365 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.498586 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.498685 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.498891 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.498976 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.499189 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.499281 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.499504 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.499595 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.499837 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.499937 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.500149 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.500244 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.500453 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.500548 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.500754 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.500841 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.501073 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.501164 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.501387 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.501476 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.501695 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.501789 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.502012 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.502136 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.502861 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.502985 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.503184 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.503308 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.503493 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.503618 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.503823 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.503941 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.504134 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.504247 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.504442 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.504572 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.504749 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.504864 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.505058 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.505172 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.505367 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.505495 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.505677 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.505793 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.505987 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.506111 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.506297 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.506422 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.506606 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.506721 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.506909 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.507023 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.507219 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.507342 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.507526 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.507641 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.507851 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.507944 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.508175 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.508265 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.508482 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.508568 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.508783 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.508878 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.509089 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.509177 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.509390 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.509476 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.509696 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.509780 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.509995 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.510088 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.510310 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.510402 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.510619 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.510716 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.510946 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.511079 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.511264 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.511351 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.511568 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.511664 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.511910 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.512228 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.512351 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.512544 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.512660 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.512846 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.512971 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.513241 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.513355 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.513554 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.513674 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.513864 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.513980 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.514173 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.514288 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.514474 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.514599 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.514776 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.514890 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.515085 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.515200 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.515407 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.515531 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.515709 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.515879 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.516033 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.516149 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.516796 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.516884 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.516964 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.517042 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.517133 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.517213 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.517299 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.517408 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.517628 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.517756 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.517961 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.518052 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.518265 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.518354 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.518651 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.518736 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.518962 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.519059 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.519268 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.519354 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.519572 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.519657 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.519910 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.520018 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.520218 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.520313 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.520519 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.520604 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.520830 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.520951 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.521136 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.521273 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.521463 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.521581 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.521783 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.521998 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.522095 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.522313 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.522412 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.522627 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.522714 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.522951 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.523046 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.523275 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.523364 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.523584 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.523677 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.523923 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.524022 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.524241 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.524328 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.524555 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.524642 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.524882 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.525025 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.525210 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.525298 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.525528 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.525622 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.525829 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.525924 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.526131 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.526218 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.526440 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.526526 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.526743 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.526842 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.527045 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.527146 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.527365 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.527451 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.527667 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.527810 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.527998 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.528143 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.528304 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.528460 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.528610 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.528787 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.528911 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.529116 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.529215 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.529427 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.529572 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.529736 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.529824 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.530053 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.530142 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.530363 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.530458 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.530673 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.530760 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.531000 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.531086 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.531301 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.531394 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.531617 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.531702 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.531944 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.532032 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.532247 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.532334 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.532547 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.532641 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.532848 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.532935 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.533173 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.533259 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.533501 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.533592 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.533830 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.533916 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.534148 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.534234 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.534472 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.534557 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.534781 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.534876 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.535094 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.535179 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.535418 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.535509 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.535729 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.535850 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.536061 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.536156 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.536370 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.536456 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.536669 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.536763 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.536970 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.537061 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.537277 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.537363 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.537577 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.537677 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.537879 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.537969 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.538179 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.538274 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.538485 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.538573 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.538785 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.538872 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.539085 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.539193 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.539386 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.539514 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.539705 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.539863 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.540030 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.540192 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.540350 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.540500 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.540658 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.540807 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.540957 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.541120 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.541258 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.541433 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.541561 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.541739 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.541901 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.542044 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.542202 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.542356 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.542531 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.542662 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.542848 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.542967 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.543167 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.543274 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.543492 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.543600 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.543822 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.543926 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.544148 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.544235 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.544482 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.544570 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.544780 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.544868 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.545097 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.545183 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.545409 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.545497 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.545722 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.545810 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.546034 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.546121 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.546347 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.546447 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.546655 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.546751 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.546967 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.547054 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.547282 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.547376 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.547596 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.547684 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.547948 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.548146 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.548270 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.548476 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.548573 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.548789 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.548884 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.549622 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.549720 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.549943 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.550032 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.550253 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.550340 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.550565 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.550651 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.550875 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.550970 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.551183 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.551271 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.551490 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.551585 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.551820 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.551913 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.552146 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.552398 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.552495 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.552733 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.552821 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.553303 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.553396 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.553624 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.553711 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.553939 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.554034 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.554253 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.554339 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.554567 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.554652 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.554882 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.554970 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.555195 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.555282 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.555505 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.555600 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.555844 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.555974 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.556159 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.556260 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.556471 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.556567 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.556803 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.556889 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.557143 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.557251 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.557463 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.557603 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.557782 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.557919 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.558100 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.558232 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.558418 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.558543 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.558779 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.558868 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.559099 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.559185 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.559409 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.559497 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.559725 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.559881 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.560066 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.560165 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.560383 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.560473 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.560696 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.560783 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.561011 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.561106 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.561324 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.561528 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.561637 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.561849 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.561958 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.562180 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.562269 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.562505 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.562591 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.562828 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.562924 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.563143 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.563230 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.563457 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.563545 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.563807 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.563911 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.564116 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.564204 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.564420 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.564518 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.564748 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.565369 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.565578 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.565818 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.565926 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.566181 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.566269 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.566524 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.566611 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.566828 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.566916 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.567148 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.567243 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.567456 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.567545 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.567819 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.568015 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.568287 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.568384 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.568602 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.568695 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.568913 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.569006 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.569232 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.569327 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.569549 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.569643 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.569859 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.569953 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.570189 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.570289 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.570493 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.570584 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.570798 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.570884 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.571111 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.571207 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.571419 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.571505 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.571722 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.571984 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.572086 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.572340 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.572426 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.572645 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.572732 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.572950 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.573045 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.573259 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.573346 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.573562 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.573648 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.573890 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.573978 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.574197 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.574283 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.574502 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.574589 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.574808 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.574897 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.575121 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.575207 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.575427 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.575512 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.575732 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.575849 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.576062 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.576148 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.576364 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.576439 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.576677 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.576764 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.576981 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.577068 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.577291 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.577387 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.577596 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.577688 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.577905 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.577990 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.578208 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.578371 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.578518 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.578611 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.578824 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.578910 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.579141 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.579237 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.579449 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.579536 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.579773 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.579863 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.580088 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.580187 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.580424 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.580524 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.580742 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.580840 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.581052 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.581152 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.581364 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.581458 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.581670 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.581797 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.581991 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.582086 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.582300 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.582538 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.582626 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.582871 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.582971 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.583191 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.583278 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.583522 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.583608 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.583878 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.583981 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.584188 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.584277 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.584494 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.584580 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.584798 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.584895 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.585118 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.585202 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.585423 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.585510 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.585731 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.585827 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.586039 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.586125 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.586351 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.586594 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.586690 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.586932 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.587018 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.587248 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.587334 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.587557 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.587653 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.587889 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.587980 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.588199 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.588285 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.588507 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.588596 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.588814 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.588900 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.589138 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.589223 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.589452 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.589540 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.589766 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.589852 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.590080 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.590173 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.590396 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.590491 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.590711 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.590801 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.591023 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.591119 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.591331 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.591416 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.591635 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.591721 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.591981 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.592084 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.592288 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.592375 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.592600 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.592685 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.592913 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.593008 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.593222 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.593308 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.593525 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.593613 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.593866 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.593952 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.594191 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.594277 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.594513 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.594606 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.594835 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.594923 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.595138 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.595223 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.595455 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.595546 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.595787 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.595889 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.596127 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.596223 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.596441 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.596535 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.596746 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.596834 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.597073 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.597159 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.597390 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.597491 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.597700 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.597786 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.598026 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.598112 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.598330 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.598426 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.598632 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.598726 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.598936 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.599044 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.599244 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.599361 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.599556 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.599687 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.599882 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.600042 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.600184 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.600360 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.600483 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.600685 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.600773 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.601002 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.601098 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.601338 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.601424 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.601650 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.601735 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.601956 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.602053 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.602260 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.602347 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.602558 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.602644 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.602856 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.602944 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.603156 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.603256 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.603457 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.603543 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.603805 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.603914 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.604077 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.604165 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.604383 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.604469 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.604682 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.604770 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.604982 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.605077 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.605278 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.605364 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.605577 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.605665 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.605875 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.605962 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.606200 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.606295 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.606510 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.606594 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.606817 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.606903 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.607124 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.607282 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.607427 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.607512 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.607730 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.607847 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.608059 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.608154 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.608367 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.608454 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.608726 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.608819 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.608989 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.609085 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.609292 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.609378 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.609596 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.609688 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.609905 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.609996 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.610209 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.610302 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.610517 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.610604 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.610825 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.610920 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.611132 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.611218 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.611439 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.611526 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.612317 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.612418 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.612645 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.612731 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.612950 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.613036 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.613274 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.613360 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.613587 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.613673 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.613904 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.613998 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.614216 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.614301 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.614526 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.614621 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.614851 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.614946 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.615156 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.615243 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.615461 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.615600 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.615789 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.615898 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.616100 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.616189 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.616409 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.616496 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.616722 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.616812 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.617036 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.617122 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.617360 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.617447 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.617682 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.617777 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.617990 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.618076 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.618309 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.618395 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.618630 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.618725 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.618944 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.619034 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.619265 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.619360 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.619578 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.619664 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.619938 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.620038 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.620252 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.620352 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.620563 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.620657 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.620867 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.620954 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.621107 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 07 10:17:26.621208 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.621485 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.621818 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.622150 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.622462 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.622791 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.623121 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.623470 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.623882 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.624232 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.624564 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.624882 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.625200 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.625510 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:17:26.625756 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 07 10:17:26.682736 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO dbcounter [None req-26b76162-bac2-4e29-8b64-0a8c21c76aaf None None] Registered counter for database nova_api Jul 07 10:17:26.688076 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO dbcounter [None req-7fe63aaa-154a-493d-a545-4089046d89b4 None None] Registered counter for database nova_api Jul 07 10:17:26.794133 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG oslo_db.sqlalchemy.engines [None req-26b76162-bac2-4e29-8b64-0a8c21c76aaf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 10:17:26.798773 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG oslo_db.sqlalchemy.engines [None req-7fe63aaa-154a-493d-a545-4089046d89b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 10:17:26.801219 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writer thread running {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 10:17:26.806205 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG dbcounter [-] [103124] Writer thread running {{(pid=103124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 10:17:26.856774 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.context [None req-26b76162-bac2-4e29-8b64-0a8c21c76aaf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fd84c606-f924-4671-b7db-795cc76f382d(cell1) {{(pid=103123) load_cells /opt/stack/nova/nova/context.py:464}} Jul 07 10:17:26.860773 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-26b76162-bac2-4e29-8b64-0a8c21c76aaf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:17:26.862550 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.context [None req-7fe63aaa-154a-493d-a545-4089046d89b4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fd84c606-f924-4671-b7db-795cc76f382d(cell1) {{(pid=103124) load_cells /opt/stack/nova/nova/context.py:464}} Jul 07 10:17:26.862854 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-26b76162-bac2-4e29-8b64-0a8c21c76aaf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:17:26.863635 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-26b76162-bac2-4e29-8b64-0a8c21c76aaf None None] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:17:26.865723 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-26b76162-bac2-4e29-8b64-0a8c21c76aaf None None] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:17:26.866484 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG oslo_concurrency.lockutils [None req-7fe63aaa-154a-493d-a545-4089046d89b4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:17:26.867688 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO dbcounter [None req-26b76162-bac2-4e29-8b64-0a8c21c76aaf None None] Registered counter for database nova_cell0 Jul 07 10:17:26.868101 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG oslo_concurrency.lockutils [None req-7fe63aaa-154a-493d-a545-4089046d89b4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:17:26.868897 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG oslo_concurrency.lockutils [None req-7fe63aaa-154a-493d-a545-4089046d89b4 None None] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:17:26.871090 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG oslo_concurrency.lockutils [None req-7fe63aaa-154a-493d-a545-4089046d89b4 None None] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:17:26.871495 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO dbcounter [None req-26b76162-bac2-4e29-8b64-0a8c21c76aaf None None] Registered counter for database nova_cell1 Jul 07 10:17:26.873099 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO dbcounter [None req-7fe63aaa-154a-493d-a545-4089046d89b4 None None] Registered counter for database nova_cell0 Jul 07 10:17:26.877045 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO dbcounter [None req-7fe63aaa-154a-493d-a545-4089046d89b4 None None] Registered counter for database nova_cell1 Jul 07 10:17:26.878781 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG oslo_db.sqlalchemy.engines [None req-26b76162-bac2-4e29-8b64-0a8c21c76aaf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 10:17:26.880432 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG oslo_db.sqlalchemy.engines [None req-26b76162-bac2-4e29-8b64-0a8c21c76aaf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 10:17:26.884110 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG oslo_db.sqlalchemy.engines [None req-7fe63aaa-154a-493d-a545-4089046d89b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 10:17:26.886632 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writer thread running {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 10:17:26.887757 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG oslo_db.sqlalchemy.engines [None req-7fe63aaa-154a-493d-a545-4089046d89b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 10:17:26.887922 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writer thread running {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 10:17:26.889552 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG dbcounter [-] [103124] Writer thread running {{(pid=103124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 10:17:27.029943 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG dbcounter [-] [103124] Writer thread running {{(pid=103124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 10:17:27.031387 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO dbcounter [None req-26b76162-bac2-4e29-8b64-0a8c21c76aaf None None] Registered counter for database nova_cell0 Jul 07 10:17:27.038473 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG oslo_db.sqlalchemy.engines [None req-26b76162-bac2-4e29-8b64-0a8c21c76aaf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 10:17:27.039467 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO dbcounter [None req-7fe63aaa-154a-493d-a545-4089046d89b4 None None] Registered counter for database nova_cell0 Jul 07 10:17:27.042749 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writer thread running {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 10:17:27.047982 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG oslo_db.sqlalchemy.engines [None req-7fe63aaa-154a-493d-a545-4089046d89b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 10:17:27.052858 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG dbcounter [-] [103124] Writer thread running {{(pid=103124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 10:17:27.372713 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: WARNING keystonemiddleware.auth_token [None req-26b76162-bac2-4e29-8b64-0a8c21c76aaf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 10:17:27.379966 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: WARNING keystonemiddleware.auth_token [None req-26b76162-bac2-4e29-8b64-0a8c21c76aaf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 10:17:27.381288 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: WARNING keystonemiddleware.auth_token [None req-7fe63aaa-154a-493d-a545-4089046d89b4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 10:17:27.388645 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: WARNING keystonemiddleware.auth_token [None req-7fe63aaa-154a-493d-a545-4089046d89b4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 10:17:27.716598 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: WARNING keystonemiddleware.auth_token [None req-26b76162-bac2-4e29-8b64-0a8c21c76aaf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 10:17:27.722457 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: WARNING keystonemiddleware.auth_token [None req-26b76162-bac2-4e29-8b64-0a8c21c76aaf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 10:17:27.727647 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563256f069c0 pid: 103123 (default app) Jul 07 10:17:27.729677 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-26b76162-bac2-4e29-8b64-0a8c21c76aaf None None] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:17:27.730859 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-26b76162-bac2-4e29-8b64-0a8c21c76aaf None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001700 Jul 07 10:17:27.731266 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Thu Jul 7 10:17:27 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:17:27.732663 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: WARNING keystonemiddleware.auth_token [None req-7fe63aaa-154a-493d-a545-4089046d89b4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 10:17:27.738729 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: WARNING keystonemiddleware.auth_token [None req-7fe63aaa-154a-493d-a545-4089046d89b4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 10:17:27.744000 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563256f069c0 pid: 103124 (default app) Jul 07 10:18:41.697313 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-26b76162-bac2-4e29-8b64-0a8c21c76aaf None None] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:18:41.698329 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-26b76162-bac2-4e29-8b64-0a8c21c76aaf None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jul 07 10:18:41.698725 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jul 7 10:18:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:18:41.715225 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG dbcounter [-] [103124] Writing DB stats nova_api:SELECT=3 {{(pid=103124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:18:41.716531 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG dbcounter [-] [103124] Writing DB stats nova_cell0:SELECT=3 {{(pid=103124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:18:41.717411 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG dbcounter [-] [103124] Writing DB stats nova_cell1:SELECT=3 {{(pid=103124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:18:41.718498 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG dbcounter [-] [103124] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:18:42.150222 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-ea6a6a2a-6cb1-4817-ba60-d2b32d2b8f31 admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:18:42.180901 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-ea6a6a2a-6cb1-4817-ba60-d2b32d2b8f31 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.475032 Jul 07 10:18:42.181687 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1291 bytes} [Thu Jul 7 10:18:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:18:44.235043 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-26b76162-bac2-4e29-8b64-0a8c21c76aaf None None] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:18:44.236081 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-26b76162-bac2-4e29-8b64-0a8c21c76aaf None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jul 07 10:18:44.236481 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jul 7 10:18:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:18:44.300645 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-98b1380f-9ad0-4239-a438-b394cd6d10c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "rxtx_factor": 1.0, "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "os-flavor-access:is_public": true, "id": "c1", "swap": 0}} {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:18:44.322795 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 10:18:44.322795 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: warnings.warn(msg) Jul 07 10:18:44.352398 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-98b1380f-9ad0-4239-a438-b394cd6d10c9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.109819 Jul 07 10:18:44.355860 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1282 bytes} [Thu Jul 7 10:18:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 07 10:18:44.572370 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-29e20aaa-ddc3-4e62-bb68-52da1e1dac16 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:18:44.574762 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 10:18:44.574762 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: warnings.warn(msg) Jul 07 10:18:44.593430 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writing DB stats nova_api:SELECT=3 {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:18:44.594367 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writing DB stats nova_cell1:SELECT=3 {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:18:44.595316 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writing DB stats nova_cell0:SELECT=3 {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:18:44.596206 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:18:44.643328 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-29e20aaa-ddc3-4e62-bb68-52da1e1dac16 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.281684 Jul 07 10:18:44.655769 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1335 bytes} [Thu Jul 7 10:18:44 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:18:46.700841 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-98b1380f-9ad0-4239-a438-b394cd6d10c9 admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:18:46.701857 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-98b1380f-9ad0-4239-a438-b394cd6d10c9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jul 07 10:18:46.702260 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jul 7 10:18:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:18:46.804630 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-14f893ed-1aa5-417e-951c-422baf725338 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 5, "name": "ds512M", "swap": 0, "vcpus": 1, "ram": 512, "id": "d1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:18:46.821945 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 10:18:46.821945 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: warnings.warn(msg) Jul 07 10:18:46.840550 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-14f893ed-1aa5-417e-951c-422baf725338 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.131559 Jul 07 10:18:46.841098 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1282 bytes} [Thu Jul 7 10:18:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 07 10:18:46.852846 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-0b2c4707-3355-4266-ba4b-5e9e06f127b3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:18:46.854394 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 10:18:46.854394 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: warnings.warn(msg) Jul 07 10:18:46.887569 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-0b2c4707-3355-4266-ba4b-5e9e06f127b3 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037816 Jul 07 10:18:46.888549 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1335 bytes} [Thu Jul 7 10:18:46 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:18:48.936195 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-14f893ed-1aa5-417e-951c-422baf725338 admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:18:48.937370 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-14f893ed-1aa5-417e-951c-422baf725338 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001775 Jul 07 10:18:48.937915 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jul 7 10:18:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:18:48.998903 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-b3992258-a2b0-45b7-9f03-1a1ffac44b4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "swap": 0, "ram": 1024, "id": "d2", "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:18:49.017029 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-b3992258-a2b0-45b7-9f03-1a1ffac44b4d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072486 Jul 07 10:18:49.017900 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1282 bytes} [Thu Jul 7 10:18:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 10:18:49.029586 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-7a4ef579-0d6b-41f4-908c-8f1fd7de7978 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:18:49.053010 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-7a4ef579-0d6b-41f4-908c-8f1fd7de7978 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027154 Jul 07 10:18:49.053571 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1335 bytes} [Thu Jul 7 10:18:49 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:18:51.123580 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-b3992258-a2b0-45b7-9f03-1a1ffac44b4d admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:18:51.124624 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-b3992258-a2b0-45b7-9f03-1a1ffac44b4d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 07 10:18:51.125168 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jul 7 10:18:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:18:51.183819 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-9e3765f3-fd9e-4e5a-ba1e-795f9cdd4066 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "name": "ds2G", "vcpus": 2, "disk": 10}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:18:51.201154 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-9e3765f3-fd9e-4e5a-ba1e-795f9cdd4066 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070685 Jul 07 10:18:51.201706 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1282 bytes} [Thu Jul 7 10:18:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 10:18:51.213369 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-ec1185c2-b77f-4a04-8e3b-a65c98ea9891 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:18:51.236828 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-ec1185c2-b77f-4a04-8e3b-a65c98ea9891 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027175 Jul 07 10:18:51.237396 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1335 bytes} [Thu Jul 7 10:18:51 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:18:53.299221 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-9e3765f3-fd9e-4e5a-ba1e-795f9cdd4066 admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:18:53.300517 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-9e3765f3-fd9e-4e5a-ba1e-795f9cdd4066 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001745 Jul 07 10:18:53.300909 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jul 7 10:18:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:18:53.358070 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-88b6705d-1c3d-40a6-bbe0-819932048d4e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d4", "ram": 4096, "swap": 0, "disk": 20, "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:18:53.375661 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-88b6705d-1c3d-40a6-bbe0-819932048d4e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.068974 Jul 07 10:18:53.376247 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1282 bytes} [Thu Jul 7 10:18:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 10:18:53.388524 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-a377f75f-7506-4055-bb17-5d4c443b03e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:18:53.410131 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-a377f75f-7506-4055-bb17-5d4c443b03e0 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025864 Jul 07 10:18:53.410676 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1335 bytes} [Thu Jul 7 10:18:53 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:18:55.477047 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-88b6705d-1c3d-40a6-bbe0-819932048d4e admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:18:55.478057 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-88b6705d-1c3d-40a6-bbe0-819932048d4e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jul 07 10:18:55.478461 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jul 7 10:18:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:18:55.546444 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-38021ba8-3b94-48f8-8401-9f5111e2d6d4 admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:18:55.570676 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-38021ba8-3b94-48f8-8401-9f5111e2d6d4 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.085778 Jul 07 10:18:55.571557 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1291 bytes} [Thu Jul 7 10:18:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 10:18:57.658775 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-88b6705d-1c3d-40a6-bbe0-819932048d4e admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:18:57.659853 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-88b6705d-1c3d-40a6-bbe0-819932048d4e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 07 10:18:57.660262 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jul 7 10:18:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:18:57.721373 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-4aa85640-37d4-41fa-bc02-8917f019e1ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "1"}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:18:57.740345 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-4aa85640-37d4-41fa-bc02-8917f019e1ee admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.074171 Jul 07 10:18:57.740896 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1282 bytes} [Thu Jul 7 10:18:57 2022] POST /compute/v2.1/flavors => generated 402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 07 10:18:57.753311 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-cc5364d6-9648-45e2-83d6-dd15eb6cf5af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:18:57.780735 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-cc5364d6-9648-45e2-83d6-dd15eb6cf5af admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031041 Jul 07 10:18:57.781508 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1332 bytes} [Thu Jul 7 10:18:57 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:19:00.270983 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-4aa85640-37d4-41fa-bc02-8917f019e1ee admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:19:00.272338 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-4aa85640-37d4-41fa-bc02-8917f019e1ee admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001884 Jul 07 10:19:00.272810 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jul 7 10:19:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:19:00.345371 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-542c828b-e336-4149-95a1-fb3f16946155 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "ram": 2048, "vcpus": 1, "swap": 0, "disk": 20, "rxtx_factor": 1.0, "id": "2"}} {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:19:00.366203 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-542c828b-e336-4149-95a1-fb3f16946155 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.085370 Jul 07 10:19:00.366882 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1282 bytes} [Thu Jul 7 10:19:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 10:19:00.381782 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-522b0330-c4e6-484e-93c6-9fdcffe66627 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:19:00.406501 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-522b0330-c4e6-484e-93c6-9fdcffe66627 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029420 Jul 07 10:19:00.407087 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1332 bytes} [Thu Jul 7 10:19:00 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:19:02.457932 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-542c828b-e336-4149-95a1-fb3f16946155 admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:19:02.458944 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-542c828b-e336-4149-95a1-fb3f16946155 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jul 07 10:19:02.459352 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jul 7 10:19:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:19:02.519813 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-92459767-5c62-4106-aba2-76a0103fa0c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "id": "3", "rxtx_factor": 1.0, "vcpus": 2, "ram": 4096}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:19:02.537011 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-92459767-5c62-4106-aba2-76a0103fa0c1 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071795 Jul 07 10:19:02.537582 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1282 bytes} [Thu Jul 7 10:19:02 2022] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 10:19:02.550744 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-d83f66e6-d971-4610-8391-4a817693539d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:19:02.575477 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-d83f66e6-d971-4610-8391-4a817693539d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028575 Jul 07 10:19:02.576221 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1332 bytes} [Thu Jul 7 10:19:02 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:19:04.632626 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-92459767-5c62-4106-aba2-76a0103fa0c1 admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:19:04.633623 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-92459767-5c62-4106-aba2-76a0103fa0c1 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jul 07 10:19:04.634048 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jul 7 10:19:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:19:04.692396 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-66214787-5d34-4b1a-97a3-00c4a1448b3d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "4", "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 80, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 8192}} {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:19:04.709785 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-66214787-5d34-4b1a-97a3-00c4a1448b3d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.069470 Jul 07 10:19:04.710325 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1282 bytes} [Thu Jul 7 10:19:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 10:19:04.722075 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-2a7fff99-4ac6-4fb4-a62d-5d0e05efbe90 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:19:04.743851 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-2a7fff99-4ac6-4fb4-a62d-5d0e05efbe90 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025339 Jul 07 10:19:04.744389 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1332 bytes} [Thu Jul 7 10:19:04 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:19:06.811982 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-66214787-5d34-4b1a-97a3-00c4a1448b3d admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:19:06.812995 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-66214787-5d34-4b1a-97a3-00c4a1448b3d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 07 10:19:06.813398 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jul 7 10:19:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:19:06.873116 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-09d60ff8-2fa7-4c4a-b058-82ad585557fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "id": "5", "os-flavor-access:is_public": true, "vcpus": 8, "swap": 0, "disk": 160}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:19:06.891876 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-09d60ff8-2fa7-4c4a-b058-82ad585557fa admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.071968 Jul 07 10:19:06.895987 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1282 bytes} [Thu Jul 7 10:19:06 2022] POST /compute/v2.1/flavors => generated 408 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 10:19:06.904541 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-79b17625-b3e6-4df7-bc62-a6efb44c8d29 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:19:06.940077 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-79b17625-b3e6-4df7-bc62-a6efb44c8d29 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039338 Jul 07 10:19:06.941535 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1332 bytes} [Thu Jul 7 10:19:06 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:19:31.429065 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-09d60ff8-2fa7-4c4a-b058-82ad585557fa admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:19:31.430064 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-09d60ff8-2fa7-4c4a-b058-82ad585557fa admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 07 10:19:31.430491 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jul 7 10:19:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:19:31.441527 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG dbcounter [-] [103124] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:19:31.488848 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-ec6d36da-5a81-4c17-80de-2362b7d9e2eb admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:19:31.505946 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-ec6d36da-5a81-4c17-80de-2362b7d9e2eb admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068929 Jul 07 10:19:31.506483 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1291 bytes} [Thu Jul 7 10:19:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:19:32.415231 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-09d60ff8-2fa7-4c4a-b058-82ad585557fa admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:19:32.416250 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-09d60ff8-2fa7-4c4a-b058-82ad585557fa admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 07 10:19:32.416649 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jul 7 10:19:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:19:32.602054 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-656b8e0b-2d4b-4c84-969e-fef18d9c57a6 admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:19:32.607627 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.wsgi [None req-656b8e0b-2d4b-4c84-969e-fef18d9c57a6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 07 10:19:32.610983 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-656b8e0b-2d4b-4c84-969e-fef18d9c57a6 admin admin] Request method failure captured: Jul 07 10:19:32.610983 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 07 10:19:32.610983 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: Accept: application/json Jul 07 10:19:32.610983 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: Accept-Encoding: gzip, deflate Jul 07 10:19:32.610983 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: Connection: keep-alive Jul 07 10:19:32.610983 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: Content-Length: 0 Jul 07 10:19:32.610983 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: Host: 10.222.0.16 Jul 07 10:19:32.610983 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: Openstack-Api-Version: compute 2.90 Jul 07 10:19:32.610983 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: Openstack-System-Scope: None Jul 07 10:19:32.610983 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: User-Agent: python-novaclient Jul 07 10:19:32.610983 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Auth-Token: gAAAAABixrM0ZTVZg5dNlElZ19MGxMGgfKfSCPyl1hM7A8RcVu0j5SE2_8lQvPIAb_iL8hHeAKP_2tp3cE0F3fYs8XLQfMvqYr4qBV8uakTqMEshCZVdiprcDVXPu8iB9ihd2a2HioSzOAbjpaOFT3j3l7qgiNGsVcg4jyX9DB5lpy0Kottyt1g Jul 07 10:19:32.610983 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Domain-Id: None Jul 07 10:19:32.610983 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Domain-Name: None Jul 07 10:19:32.610983 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Identity-Status: Confirmed Jul 07 10:19:32.610983 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Is-Admin-Project: True Jul 07 10:19:32.610983 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Openstack-Nova-Api-Version: 2.90 Jul 07 10:19:32.610983 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Project-Domain-Id: default Jul 07 10:19:32.610983 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Project-Domain-Name: Default Jul 07 10:19:32.610983 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Project-Id: 3e93b5f74d6546a8b33441fdeb0e9c0d Jul 07 10:19:32.610983 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Project-Name: admin Jul 07 10:19:32.610983 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Role: member,reader,admin Jul 07 10:19:32.610983 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Roles: member,reader,admin Jul 07 10:19:32.612691 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3e93b5f74d6546a8b33441fdeb0e9c0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3e93b5f74d6546a8b33441fdeb0e9c0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3e93b5f74d6546a8b33441fdeb0e9c0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3e93b5f74d6546a8b33441fdeb0e9c0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:19:32.612691 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Tenant: admin Jul 07 10:19:32.612691 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Tenant-Id: 3e93b5f74d6546a8b33441fdeb0e9c0d Jul 07 10:19:32.612691 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Tenant-Name: admin Jul 07 10:19:32.612691 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-User: admin Jul 07 10:19:32.612691 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-User-Domain-Id: default Jul 07 10:19:32.612691 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-User-Domain-Name: Default Jul 07 10:19:32.612691 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-User-Id: 8d3febf927af4782bc2aa5631cc4dde7 Jul 07 10:19:32.612691 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-User-Name: admin Jul 07 10:19:32.612691 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: method: > Jul 07 10:19:32.612691 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: exception: Flavor 42 could not be found. Jul 07 10:19:32.612691 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: action_args: {'id': '42'} Jul 07 10:19:32.612691 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:19:32.612691 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:19:32.613708 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 07 10:19:32.613708 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 07 10:19:32.613708 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 07 10:19:32.613708 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 07 10:19:32.613708 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 07 10:19:32.613708 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 07 10:19:32.613708 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 07 10:19:32.613708 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 07 10:19:32.613708 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 07 10:19:32.613708 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:19:32.613708 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 07 10:19:32.613708 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 07 10:19:32.613708 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 07 10:19:32.613708 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Jul 07 10:19:32.613708 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:19:32.613708 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Jul 07 10:19:32.613708 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:19:32.613708 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:19:32.613708 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:19:32.614880 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:19:32.614880 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:19:32.614880 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:19:32.614880 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:19:32.614880 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 07 10:19:32.614880 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:19:32.614880 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 07 10:19:32.614880 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Jul 07 10:19:32.614880 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:19:32.614880 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Jul 07 10:19:32.614880 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:19:32.614880 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:19:32.614880 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:19:32.614880 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:19:32.614880 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:19:32.614880 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 07 10:19:32.614880 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Jul 07 10:19:32.614880 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-656b8e0b-2d4b-4c84-969e-fef18d9c57a6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:19:32.615957 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-656b8e0b-2d4b-4c84-969e-fef18d9c57a6 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061278 Jul 07 10:19:32.615957 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1190 bytes} [Thu Jul 7 10:19:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 07 10:19:32.621928 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-a48683ac-f0b9-4760-b4d9-a817631918f5 admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:19:32.624809 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:19:32.644562 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-a48683ac-f0b9-4760-b4d9-a817631918f5 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026118 Jul 07 10:19:32.645025 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Jul 7 10:19:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:19:32.655051 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-afc5cda3-d4af-4b45-bbec-eff0b7620290 admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:19:32.676029 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-afc5cda3-d4af-4b45-bbec-eff0b7620290 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025008 Jul 07 10:19:32.676547 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Jul 7 10:19:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 10:19:32.686132 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-e0d5c018-2b0e-4124-9000-80568fde68a7 admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:19:32.691961 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.wsgi [None req-e0d5c018-2b0e-4124-9000-80568fde68a7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 07 10:19:32.695221 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-e0d5c018-2b0e-4124-9000-80568fde68a7 admin admin] Request method failure captured: Jul 07 10:19:32.695221 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 07 10:19:32.695221 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: Accept: application/json Jul 07 10:19:32.695221 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: Accept-Encoding: gzip, deflate Jul 07 10:19:32.695221 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: Connection: keep-alive Jul 07 10:19:32.695221 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: Content-Length: 0 Jul 07 10:19:32.695221 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: Host: 10.222.0.16 Jul 07 10:19:32.695221 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: Openstack-Api-Version: compute 2.90 Jul 07 10:19:32.695221 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: Openstack-System-Scope: None Jul 07 10:19:32.695221 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: User-Agent: python-novaclient Jul 07 10:19:32.695221 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Auth-Token: gAAAAABixrM0ZTVZg5dNlElZ19MGxMGgfKfSCPyl1hM7A8RcVu0j5SE2_8lQvPIAb_iL8hHeAKP_2tp3cE0F3fYs8XLQfMvqYr4qBV8uakTqMEshCZVdiprcDVXPu8iB9ihd2a2HioSzOAbjpaOFT3j3l7qgiNGsVcg4jyX9DB5lpy0Kottyt1g Jul 07 10:19:32.695221 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Domain-Id: None Jul 07 10:19:32.695221 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Domain-Name: None Jul 07 10:19:32.695221 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Identity-Status: Confirmed Jul 07 10:19:32.695221 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Is-Admin-Project: True Jul 07 10:19:32.695221 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Openstack-Nova-Api-Version: 2.90 Jul 07 10:19:32.695221 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Project-Domain-Id: default Jul 07 10:19:32.695221 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Project-Domain-Name: Default Jul 07 10:19:32.695221 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Project-Id: 3e93b5f74d6546a8b33441fdeb0e9c0d Jul 07 10:19:32.695221 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Project-Name: admin Jul 07 10:19:32.695221 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Role: member,reader,admin Jul 07 10:19:32.695221 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Roles: member,reader,admin Jul 07 10:19:32.696667 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3e93b5f74d6546a8b33441fdeb0e9c0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3e93b5f74d6546a8b33441fdeb0e9c0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3e93b5f74d6546a8b33441fdeb0e9c0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3e93b5f74d6546a8b33441fdeb0e9c0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:19:32.696667 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Tenant: admin Jul 07 10:19:32.696667 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Tenant-Id: 3e93b5f74d6546a8b33441fdeb0e9c0d Jul 07 10:19:32.696667 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Tenant-Name: admin Jul 07 10:19:32.696667 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-User: admin Jul 07 10:19:32.696667 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-User-Domain-Id: default Jul 07 10:19:32.696667 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-User-Domain-Name: Default Jul 07 10:19:32.696667 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-User-Id: 8d3febf927af4782bc2aa5631cc4dde7 Jul 07 10:19:32.696667 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-User-Name: admin Jul 07 10:19:32.696667 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: method: > Jul 07 10:19:32.696667 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: exception: Flavor 42 could not be found. Jul 07 10:19:32.696667 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: action_args: {'id': '42'} Jul 07 10:19:32.696667 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:19:32.696667 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:19:32.697492 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 07 10:19:32.697492 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 07 10:19:32.697492 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 07 10:19:32.697492 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 07 10:19:32.697492 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 07 10:19:32.697492 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 07 10:19:32.697492 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 07 10:19:32.697492 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 07 10:19:32.697492 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 07 10:19:32.697492 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:19:32.697492 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 07 10:19:32.697492 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 07 10:19:32.697492 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 07 10:19:32.697492 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Jul 07 10:19:32.697492 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:19:32.697492 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Jul 07 10:19:32.697492 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:19:32.697492 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:19:32.697492 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:19:32.698725 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:19:32.698725 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:19:32.698725 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:19:32.698725 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:19:32.698725 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 07 10:19:32.698725 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:19:32.698725 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 07 10:19:32.698725 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Jul 07 10:19:32.698725 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:19:32.698725 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Jul 07 10:19:32.698725 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:19:32.698725 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:19:32.698725 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:19:32.698725 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:19:32.698725 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:19:32.698725 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 07 10:19:32.698725 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Jul 07 10:19:32.698725 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-e0d5c018-2b0e-4124-9000-80568fde68a7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:19:32.700499 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-e0d5c018-2b0e-4124-9000-80568fde68a7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014535 Jul 07 10:19:32.700499 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1190 bytes} [Thu Jul 7 10:19:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 07 10:19:33.508341 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-afc5cda3-d4af-4b45-bbec-eff0b7620290 admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:19:33.509407 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-afc5cda3-d4af-4b45-bbec-eff0b7620290 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Jul 07 10:19:33.509810 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jul 7 10:19:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:19:33.697133 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-8768469c-3a03-4fd8-9986-2c4667888c6e admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:19:33.702968 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.wsgi [None req-8768469c-3a03-4fd8-9986-2c4667888c6e admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 07 10:19:33.704518 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-8768469c-3a03-4fd8-9986-2c4667888c6e admin admin] Request method failure captured: Jul 07 10:19:33.704518 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 07 10:19:33.704518 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: Accept: application/json Jul 07 10:19:33.704518 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: Accept-Encoding: gzip, deflate Jul 07 10:19:33.704518 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: Connection: keep-alive Jul 07 10:19:33.704518 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: Content-Length: 0 Jul 07 10:19:33.704518 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: Host: 10.222.0.16 Jul 07 10:19:33.704518 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: Openstack-Api-Version: compute 2.90 Jul 07 10:19:33.704518 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: Openstack-System-Scope: None Jul 07 10:19:33.704518 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: User-Agent: python-novaclient Jul 07 10:19:33.704518 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Auth-Token: gAAAAABixrM1RC7mcmdi4MgvffV3ERrYA7w40s3-6qysEtd1UASkHdKoPE3uz9yjIcyxNEhTaFYE38ihR49p_U9zFn_86fONeFYCuWN1BR8-HRZGlIe_I26XY_iAFGsWSgQuhLQkD2OOHK58kganzfMZ993cSd0LnX7ENztQO_9WHpLkZ0sshfo Jul 07 10:19:33.704518 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Domain-Id: None Jul 07 10:19:33.704518 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Domain-Name: None Jul 07 10:19:33.704518 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Identity-Status: Confirmed Jul 07 10:19:33.704518 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Is-Admin-Project: True Jul 07 10:19:33.704518 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Openstack-Nova-Api-Version: 2.90 Jul 07 10:19:33.704518 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Project-Domain-Id: default Jul 07 10:19:33.704518 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Project-Domain-Name: Default Jul 07 10:19:33.704518 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Project-Id: 3e93b5f74d6546a8b33441fdeb0e9c0d Jul 07 10:19:33.704518 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Project-Name: admin Jul 07 10:19:33.704518 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Role: member,reader,admin Jul 07 10:19:33.704518 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Roles: member,reader,admin Jul 07 10:19:33.706018 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3e93b5f74d6546a8b33441fdeb0e9c0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3e93b5f74d6546a8b33441fdeb0e9c0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3e93b5f74d6546a8b33441fdeb0e9c0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3e93b5f74d6546a8b33441fdeb0e9c0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:19:33.706018 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Tenant: admin Jul 07 10:19:33.706018 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Tenant-Id: 3e93b5f74d6546a8b33441fdeb0e9c0d Jul 07 10:19:33.706018 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Tenant-Name: admin Jul 07 10:19:33.706018 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-User: admin Jul 07 10:19:33.706018 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-User-Domain-Id: default Jul 07 10:19:33.706018 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-User-Domain-Name: Default Jul 07 10:19:33.706018 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-User-Id: 8d3febf927af4782bc2aa5631cc4dde7 Jul 07 10:19:33.706018 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-User-Name: admin Jul 07 10:19:33.706018 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: method: > Jul 07 10:19:33.706018 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: exception: Flavor 84 could not be found. Jul 07 10:19:33.706018 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: action_args: {'id': '84'} Jul 07 10:19:33.706018 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:19:33.706018 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:19:33.706899 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 07 10:19:33.706899 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 07 10:19:33.706899 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 07 10:19:33.706899 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 07 10:19:33.706899 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 07 10:19:33.706899 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 07 10:19:33.706899 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 07 10:19:33.706899 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 07 10:19:33.706899 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 07 10:19:33.706899 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:19:33.706899 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 07 10:19:33.706899 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 07 10:19:33.706899 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 07 10:19:33.706899 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Jul 07 10:19:33.706899 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:19:33.706899 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Jul 07 10:19:33.706899 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:19:33.706899 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:19:33.706899 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:19:33.707978 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:19:33.707978 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:19:33.707978 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:19:33.707978 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:19:33.707978 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 07 10:19:33.707978 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:19:33.707978 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 07 10:19:33.707978 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Jul 07 10:19:33.707978 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:19:33.707978 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Jul 07 10:19:33.707978 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:19:33.707978 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:19:33.707978 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:19:33.707978 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:19:33.707978 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:19:33.707978 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 07 10:19:33.707978 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Jul 07 10:19:33.707978 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-8768469c-3a03-4fd8-9986-2c4667888c6e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:19:33.708991 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-8768469c-3a03-4fd8-9986-2c4667888c6e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060733 Jul 07 10:19:33.708991 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1190 bytes} [Thu Jul 7 10:19:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 07 10:19:33.716568 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-a75723e3-cc6f-4485-954d-e500a091f6f7 admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:19:33.729941 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-a75723e3-cc6f-4485-954d-e500a091f6f7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018039 Jul 07 10:19:33.730954 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Jul 7 10:19:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:19:33.740167 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-d16efc5c-4f30-4f05-ab97-7d44763ce1db admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:19:33.753543 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-d16efc5c-4f30-4f05-ab97-7d44763ce1db admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017058 Jul 07 10:19:33.754054 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Jul 7 10:19:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 10:19:33.762796 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-89749d9e-8665-49ee-aaf5-217e50d85d23 admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:19:33.768205 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.wsgi [None req-89749d9e-8665-49ee-aaf5-217e50d85d23 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 07 10:19:33.769687 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-89749d9e-8665-49ee-aaf5-217e50d85d23 admin admin] Request method failure captured: Jul 07 10:19:33.769687 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 07 10:19:33.769687 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: Accept: application/json Jul 07 10:19:33.769687 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: Accept-Encoding: gzip, deflate Jul 07 10:19:33.769687 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: Connection: keep-alive Jul 07 10:19:33.769687 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: Content-Length: 0 Jul 07 10:19:33.769687 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: Host: 10.222.0.16 Jul 07 10:19:33.769687 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: Openstack-Api-Version: compute 2.90 Jul 07 10:19:33.769687 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: Openstack-System-Scope: None Jul 07 10:19:33.769687 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: User-Agent: python-novaclient Jul 07 10:19:33.769687 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Auth-Token: gAAAAABixrM1RC7mcmdi4MgvffV3ERrYA7w40s3-6qysEtd1UASkHdKoPE3uz9yjIcyxNEhTaFYE38ihR49p_U9zFn_86fONeFYCuWN1BR8-HRZGlIe_I26XY_iAFGsWSgQuhLQkD2OOHK58kganzfMZ993cSd0LnX7ENztQO_9WHpLkZ0sshfo Jul 07 10:19:33.769687 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Domain-Id: None Jul 07 10:19:33.769687 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Domain-Name: None Jul 07 10:19:33.769687 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Identity-Status: Confirmed Jul 07 10:19:33.769687 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Is-Admin-Project: True Jul 07 10:19:33.769687 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Openstack-Nova-Api-Version: 2.90 Jul 07 10:19:33.769687 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Project-Domain-Id: default Jul 07 10:19:33.769687 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Project-Domain-Name: Default Jul 07 10:19:33.769687 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Project-Id: 3e93b5f74d6546a8b33441fdeb0e9c0d Jul 07 10:19:33.769687 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Project-Name: admin Jul 07 10:19:33.769687 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Role: member,reader,admin Jul 07 10:19:33.769687 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Roles: member,reader,admin Jul 07 10:19:33.771270 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3e93b5f74d6546a8b33441fdeb0e9c0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3e93b5f74d6546a8b33441fdeb0e9c0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3e93b5f74d6546a8b33441fdeb0e9c0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3e93b5f74d6546a8b33441fdeb0e9c0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:19:33.771270 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Tenant: admin Jul 07 10:19:33.771270 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Tenant-Id: 3e93b5f74d6546a8b33441fdeb0e9c0d Jul 07 10:19:33.771270 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Tenant-Name: admin Jul 07 10:19:33.771270 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-User: admin Jul 07 10:19:33.771270 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-User-Domain-Id: default Jul 07 10:19:33.771270 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-User-Domain-Name: Default Jul 07 10:19:33.771270 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-User-Id: 8d3febf927af4782bc2aa5631cc4dde7 Jul 07 10:19:33.771270 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-User-Name: admin Jul 07 10:19:33.771270 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: method: > Jul 07 10:19:33.771270 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: exception: Flavor 84 could not be found. Jul 07 10:19:33.771270 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: action_args: {'id': '84'} Jul 07 10:19:33.771270 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:19:33.771270 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:19:33.772363 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 07 10:19:33.772363 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 07 10:19:33.772363 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 07 10:19:33.772363 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 07 10:19:33.772363 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 07 10:19:33.772363 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 07 10:19:33.772363 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 07 10:19:33.772363 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 07 10:19:33.772363 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 07 10:19:33.772363 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:19:33.772363 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 07 10:19:33.772363 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 07 10:19:33.772363 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 07 10:19:33.772363 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Jul 07 10:19:33.772363 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:19:33.772363 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Jul 07 10:19:33.772363 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:19:33.772363 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:19:33.772363 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:19:33.773635 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:19:33.773635 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:19:33.773635 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:19:33.773635 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:19:33.773635 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 07 10:19:33.773635 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:19:33.773635 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 07 10:19:33.773635 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Jul 07 10:19:33.773635 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:19:33.773635 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Jul 07 10:19:33.773635 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:19:33.773635 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:19:33.773635 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:19:33.773635 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:19:33.773635 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:19:33.773635 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 07 10:19:33.773635 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Jul 07 10:19:33.773635 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-89749d9e-8665-49ee-aaf5-217e50d85d23 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:19:33.774850 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-89749d9e-8665-49ee-aaf5-217e50d85d23 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011681 Jul 07 10:19:33.774850 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1190 bytes} [Thu Jul 7 10:19:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 07 10:19:34.586597 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-d16efc5c-4f30-4f05-ab97-7d44763ce1db admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:19:34.587599 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-d16efc5c-4f30-4f05-ab97-7d44763ce1db admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 07 10:19:34.588034 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jul 7 10:19:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:19:34.775032 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-7ae8e0b4-170c-4e4b-8022-55d330fd3c00 admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:19:34.781496 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.wsgi [None req-7ae8e0b4-170c-4e4b-8022-55d330fd3c00 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 07 10:19:34.782993 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-7ae8e0b4-170c-4e4b-8022-55d330fd3c00 admin admin] Request method failure captured: Jul 07 10:19:34.782993 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 07 10:19:34.782993 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: Accept: application/json Jul 07 10:19:34.782993 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: Accept-Encoding: gzip, deflate Jul 07 10:19:34.782993 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: Connection: keep-alive Jul 07 10:19:34.782993 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: Content-Length: 0 Jul 07 10:19:34.782993 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: Host: 10.222.0.16 Jul 07 10:19:34.782993 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: Openstack-Api-Version: compute 2.90 Jul 07 10:19:34.782993 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: Openstack-System-Scope: None Jul 07 10:19:34.782993 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: User-Agent: python-novaclient Jul 07 10:19:34.782993 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Auth-Token: gAAAAABixrM2xZnGXRkzibgKrVRnU1oI_Q6xs9MwUkQXXmMTLX5MqdackhnG5ROgTsSex1zJJx10saz-CU3OfpfKTyXqg7jqXarw165XKgzHHFT-c_s8FbO8h1r-Ym0y6RNNHJmYxKE2tuy1ZLvMaak0myA1-smRfN0VbsrcjVdd9xRp9AihTHc Jul 07 10:19:34.782993 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Domain-Id: None Jul 07 10:19:34.782993 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Domain-Name: None Jul 07 10:19:34.782993 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Identity-Status: Confirmed Jul 07 10:19:34.782993 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Is-Admin-Project: True Jul 07 10:19:34.782993 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Openstack-Nova-Api-Version: 2.90 Jul 07 10:19:34.782993 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Project-Domain-Id: default Jul 07 10:19:34.782993 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Project-Domain-Name: Default Jul 07 10:19:34.782993 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Project-Id: 3e93b5f74d6546a8b33441fdeb0e9c0d Jul 07 10:19:34.782993 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Project-Name: admin Jul 07 10:19:34.782993 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Role: member,reader,admin Jul 07 10:19:34.782993 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Roles: member,reader,admin Jul 07 10:19:34.784537 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3e93b5f74d6546a8b33441fdeb0e9c0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3e93b5f74d6546a8b33441fdeb0e9c0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3e93b5f74d6546a8b33441fdeb0e9c0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3e93b5f74d6546a8b33441fdeb0e9c0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:19:34.784537 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Tenant: admin Jul 07 10:19:34.784537 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Tenant-Id: 3e93b5f74d6546a8b33441fdeb0e9c0d Jul 07 10:19:34.784537 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-Tenant-Name: admin Jul 07 10:19:34.784537 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-User: admin Jul 07 10:19:34.784537 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-User-Domain-Id: default Jul 07 10:19:34.784537 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-User-Domain-Name: Default Jul 07 10:19:34.784537 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-User-Id: 8d3febf927af4782bc2aa5631cc4dde7 Jul 07 10:19:34.784537 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: X-User-Name: admin Jul 07 10:19:34.784537 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: method: > Jul 07 10:19:34.784537 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: exception: Flavor 451 could not be found. Jul 07 10:19:34.784537 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: action_args: {'id': '451'} Jul 07 10:19:34.784537 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:19:34.784537 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:19:34.785476 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 07 10:19:34.785476 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 07 10:19:34.785476 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 07 10:19:34.785476 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 07 10:19:34.785476 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 07 10:19:34.785476 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 07 10:19:34.785476 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 07 10:19:34.785476 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 07 10:19:34.785476 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 07 10:19:34.785476 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:19:34.785476 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 07 10:19:34.785476 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 07 10:19:34.785476 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 07 10:19:34.785476 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Jul 07 10:19:34.785476 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:19:34.785476 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Jul 07 10:19:34.785476 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:19:34.785476 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:19:34.785476 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:19:34.786792 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:19:34.786792 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:19:34.786792 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:19:34.786792 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:19:34.786792 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 07 10:19:34.786792 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:19:34.786792 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 07 10:19:34.786792 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Jul 07 10:19:34.786792 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:19:34.786792 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Jul 07 10:19:34.786792 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:19:34.786792 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:19:34.786792 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:19:34.786792 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:19:34.786792 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:19:34.786792 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 07 10:19:34.786792 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: ERROR nova.api.openstack.wsgi Jul 07 10:19:34.786792 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-7ae8e0b4-170c-4e4b-8022-55d330fd3c00 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:19:34.788166 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-7ae8e0b4-170c-4e4b-8022-55d330fd3c00 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059578 Jul 07 10:19:34.788166 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Jul 7 10:19:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 07 10:19:34.794517 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-c0a7bb9d-f2c7-485b-a1d6-149b9ced54ec admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:19:34.808168 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-c0a7bb9d-f2c7-485b-a1d6-149b9ced54ec admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017515 Jul 07 10:19:34.808695 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Jul 7 10:19:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:19:34.817945 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-427c7a9d-4098-4996-b791-694583592a26 admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:19:34.833225 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-427c7a9d-4098-4996-b791-694583592a26 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018776 Jul 07 10:19:34.833758 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Jul 7 10:19:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:19:34.843532 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-76856a8b-d0d2-45a8-80eb-2f186a14853d admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:19:34.848875 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.wsgi [None req-76856a8b-d0d2-45a8-80eb-2f186a14853d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 07 10:19:34.850427 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-76856a8b-d0d2-45a8-80eb-2f186a14853d admin admin] Request method failure captured: Jul 07 10:19:34.850427 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 07 10:19:34.850427 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: Accept: application/json Jul 07 10:19:34.850427 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: Accept-Encoding: gzip, deflate Jul 07 10:19:34.850427 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: Connection: keep-alive Jul 07 10:19:34.850427 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: Content-Length: 0 Jul 07 10:19:34.850427 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: Host: 10.222.0.16 Jul 07 10:19:34.850427 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: Openstack-Api-Version: compute 2.90 Jul 07 10:19:34.850427 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: Openstack-System-Scope: None Jul 07 10:19:34.850427 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: User-Agent: python-novaclient Jul 07 10:19:34.850427 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Auth-Token: gAAAAABixrM2xZnGXRkzibgKrVRnU1oI_Q6xs9MwUkQXXmMTLX5MqdackhnG5ROgTsSex1zJJx10saz-CU3OfpfKTyXqg7jqXarw165XKgzHHFT-c_s8FbO8h1r-Ym0y6RNNHJmYxKE2tuy1ZLvMaak0myA1-smRfN0VbsrcjVdd9xRp9AihTHc Jul 07 10:19:34.850427 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Domain-Id: None Jul 07 10:19:34.850427 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Domain-Name: None Jul 07 10:19:34.850427 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Identity-Status: Confirmed Jul 07 10:19:34.850427 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Is-Admin-Project: True Jul 07 10:19:34.850427 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Openstack-Nova-Api-Version: 2.90 Jul 07 10:19:34.850427 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Project-Domain-Id: default Jul 07 10:19:34.850427 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Project-Domain-Name: Default Jul 07 10:19:34.850427 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Project-Id: 3e93b5f74d6546a8b33441fdeb0e9c0d Jul 07 10:19:34.850427 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Project-Name: admin Jul 07 10:19:34.850427 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Role: member,reader,admin Jul 07 10:19:34.850427 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Roles: member,reader,admin Jul 07 10:19:34.851994 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3e93b5f74d6546a8b33441fdeb0e9c0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3e93b5f74d6546a8b33441fdeb0e9c0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3e93b5f74d6546a8b33441fdeb0e9c0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3e93b5f74d6546a8b33441fdeb0e9c0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:19:34.851994 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Tenant: admin Jul 07 10:19:34.851994 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Tenant-Id: 3e93b5f74d6546a8b33441fdeb0e9c0d Jul 07 10:19:34.851994 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-Tenant-Name: admin Jul 07 10:19:34.851994 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-User: admin Jul 07 10:19:34.851994 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-User-Domain-Id: default Jul 07 10:19:34.851994 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-User-Domain-Name: Default Jul 07 10:19:34.851994 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-User-Id: 8d3febf927af4782bc2aa5631cc4dde7 Jul 07 10:19:34.851994 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: X-User-Name: admin Jul 07 10:19:34.851994 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: method: > Jul 07 10:19:34.851994 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: exception: Flavor 451 could not be found. Jul 07 10:19:34.851994 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: action_args: {'id': '451'} Jul 07 10:19:34.851994 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:19:34.851994 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:19:34.852872 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 07 10:19:34.852872 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 07 10:19:34.852872 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 07 10:19:34.852872 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 07 10:19:34.852872 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 07 10:19:34.852872 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 07 10:19:34.852872 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 07 10:19:34.852872 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 07 10:19:34.852872 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 07 10:19:34.852872 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:19:34.852872 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 07 10:19:34.852872 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 07 10:19:34.852872 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 07 10:19:34.852872 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Jul 07 10:19:34.852872 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:19:34.852872 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Jul 07 10:19:34.852872 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:19:34.852872 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:19:34.852872 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:19:34.853917 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:19:34.853917 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:19:34.853917 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:19:34.853917 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:19:34.853917 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 07 10:19:34.853917 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:19:34.853917 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 07 10:19:34.853917 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Jul 07 10:19:34.853917 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:19:34.853917 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Jul 07 10:19:34.853917 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:19:34.853917 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:19:34.853917 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:19:34.853917 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:19:34.853917 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:19:34.853917 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 07 10:19:34.853917 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Jul 07 10:19:34.853917 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-76856a8b-d0d2-45a8-80eb-2f186a14853d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:19:34.854917 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-76856a8b-d0d2-45a8-80eb-2f186a14853d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012476 Jul 07 10:19:34.854917 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Jul 7 10:19:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 07 10:19:35.658932 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-427c7a9d-4098-4996-b791-694583592a26 admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:19:35.659959 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-427c7a9d-4098-4996-b791-694583592a26 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Jul 07 10:19:35.660355 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jul 7 10:19:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:19:35.850828 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-646f7071-93fb-45ea-becc-219cd8f8ccd9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:19:35.870675 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-646f7071-93fb-45ea-becc-219cd8f8ccd9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.071237 Jul 07 10:19:35.871330 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1235 bytes} [Thu Jul 7 10:19:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 10:19:36.686754 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-427c7a9d-4098-4996-b791-694583592a26 admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:19:36.687840 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-427c7a9d-4098-4996-b791-694583592a26 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 07 10:19:36.688262 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jul 7 10:19:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:19:36.874764 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-153ed2af-5887-4d2c-96de-c71d3e31abda admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:19:36.892678 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-153ed2af-5887-4d2c-96de-c71d3e31abda admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069004 Jul 07 10:19:36.893325 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1235 bytes} [Thu Jul 7 10:19:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 10:19:37.710830 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-427c7a9d-4098-4996-b791-694583592a26 admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:19:37.711851 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-427c7a9d-4098-4996-b791-694583592a26 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001392 Jul 07 10:19:37.712243 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jul 7 10:19:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:19:37.901534 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-3e8bb211-22d5-45b7-89dd-9bb71263304a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:19:37.919348 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-3e8bb211-22d5-45b7-89dd-9bb71263304a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068844 Jul 07 10:19:37.919918 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1235 bytes} [Thu Jul 7 10:19:37 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 10:19:38.731656 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-427c7a9d-4098-4996-b791-694583592a26 admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:19:38.732700 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-427c7a9d-4098-4996-b791-694583592a26 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jul 07 10:19:38.733097 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jul 7 10:19:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:19:38.920669 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-594d2c97-b807-4c4b-9514-1ade0d814f2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:19:38.939428 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-594d2c97-b807-4c4b-9514-1ade0d814f2e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070275 Jul 07 10:19:38.939996 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1235 bytes} [Thu Jul 7 10:19:38 2022] POST /compute/v2.1/flavors => generated 409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 10:19:39.752660 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-427c7a9d-4098-4996-b791-694583592a26 admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:19:39.753652 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-427c7a9d-4098-4996-b791-694583592a26 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Jul 07 10:19:39.754049 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jul 7 10:19:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:19:39.941921 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-e82b0ef4-080f-4a01-8fe9-6b4f076d17a7 admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:19:39.961243 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-e82b0ef4-080f-4a01-8fe9-6b4f076d17a7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069703 Jul 07 10:19:39.961768 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1202 bytes} [Thu Jul 7 10:19:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:20:26.111265 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-427c7a9d-4098-4996-b791-694583592a26 admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:20:26.112312 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-427c7a9d-4098-4996-b791-694583592a26 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 07 10:20:26.112710 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jul 7 10:20:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:20:26.122771 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:20:26.169863 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-2acc4009-7db7-4fab-862d-3aa34b2f8471 admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:20:26.189253 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-2acc4009-7db7-4fab-862d-3aa34b2f8471 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070877 Jul 07 10:20:26.189777 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1291 bytes} [Thu Jul 7 10:20:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:20:26.213388 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-af74ed44-b348-4187-9558-75c65bad310a admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:20:26.216838 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG dbcounter [-] [103124] Writing DB stats nova_api:SELECT=14 {{(pid=103124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:20:26.222414 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-af74ed44-b348-4187-9558-75c65bad310a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012588 Jul 07 10:20:26.222931 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1282 bytes} [Thu Jul 7 10:20:26 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:20:26.234011 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-e39df561-1054-4886-a7c2-cea71895b377 admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:20:26.241410 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-e39df561-1054-4886-a7c2-cea71895b377 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010904 Jul 07 10:20:26.241904 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1285 bytes} [Thu Jul 7 10:20:26 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:20:26.253444 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-beac93ff-5131-4297-8ce4-d3af35b9f96f admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:20:26.260763 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-beac93ff-5131-4297-8ce4-d3af35b9f96f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011263 Jul 07 10:20:26.261264 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1285 bytes} [Thu Jul 7 10:20:26 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:20:26.272542 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-d2a3f526-2db5-4e7e-9a72-66fb814fae2c admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:20:26.279940 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-d2a3f526-2db5-4e7e-9a72-66fb814fae2c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010868 Jul 07 10:20:26.280451 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1282 bytes} [Thu Jul 7 10:20:26 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:23:45.277945 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-beac93ff-5131-4297-8ce4-d3af35b9f96f admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:23:45.278954 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-beac93ff-5131-4297-8ce4-d3af35b9f96f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jul 07 10:23:45.279357 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jul 7 10:23:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:23:45.416452 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writing DB stats nova_api:SELECT=6 {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:23:45.528333 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-9c848759-591d-4bab-bb09-df9f24e2ed61 admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:23:45.529484 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 10:23:45.529484 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: warnings.warn(msg) Jul 07 10:23:45.530700 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-9c848759-591d-4bab-bb09-df9f24e2ed61 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:23:45.531134 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-9c848759-591d-4bab-bb09-df9f24e2ed61 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:23:45.531951 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-9c848759-591d-4bab-bb09-df9f24e2ed61 admin admin] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:23:45.532377 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-9c848759-591d-4bab-bb09-df9f24e2ed61 admin admin] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:23:45.566746 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-9c848759-591d-4bab-bb09-df9f24e2ed61 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152016 Jul 07 10:23:45.567292 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 36/70] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Jul 7 10:23:45 2022] GET /compute/v2.1/os-services => generated 791 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 10:23:46.385006 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-beac93ff-5131-4297-8ce4-d3af35b9f96f admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:23:46.386032 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-beac93ff-5131-4297-8ce4-d3af35b9f96f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001975 Jul 07 10:23:46.386429 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 35/71] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jul 7 10:23:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:23:46.579236 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-f2678a51-1a49-4473-928a-bded848484f1 admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:23:46.580424 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 10:23:46.580424 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: warnings.warn(msg) Jul 07 10:23:46.581601 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-f2678a51-1a49-4473-928a-bded848484f1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:23:46.582044 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-f2678a51-1a49-4473-928a-bded848484f1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:23:46.582861 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-f2678a51-1a49-4473-928a-bded848484f1 admin admin] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:23:46.583289 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-f2678a51-1a49-4473-928a-bded848484f1 admin admin] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:23:46.603613 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-f2678a51-1a49-4473-928a-bded848484f1 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078989 Jul 07 10:23:46.604122 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 37/72] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Jul 7 10:23:46 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 10:23:57.837361 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-beac93ff-5131-4297-8ce4-d3af35b9f96f admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:23:57.838917 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-beac93ff-5131-4297-8ce4-d3af35b9f96f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001977 Jul 07 10:23:57.839328 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 36/73] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jul 7 10:23:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:23:57.979808 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writing DB stats nova_cell0:SELECT=4 {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:23:57.980534 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writing DB stats nova_cell1:SELECT=4 {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:23:57.981147 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writing DB stats nova_api:SELECT=8 {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:23:58.028893 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-eccf320b-dbc9-4558-8b28-5cc55580ee8e admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:23:58.030057 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 10:23:58.030057 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: warnings.warn(msg) Jul 07 10:23:58.031234 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-eccf320b-dbc9-4558-8b28-5cc55580ee8e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:23:58.031675 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-eccf320b-dbc9-4558-8b28-5cc55580ee8e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:23:58.032514 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-eccf320b-dbc9-4558-8b28-5cc55580ee8e admin admin] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:23:58.032944 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-eccf320b-dbc9-4558-8b28-5cc55580ee8e admin admin] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:23:58.058064 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-eccf320b-dbc9-4558-8b28-5cc55580ee8e admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083242 Jul 07 10:23:58.058534 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 38/74] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Jul 7 10:23:57 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:23:58.876357 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: DEBUG nova.api.openstack.wsgi [None req-beac93ff-5131-4297-8ce4-d3af35b9f96f admin admin] Calling method '>' {{(pid=103124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:23:58.877342 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: INFO nova.api.openstack.requestlog [None req-beac93ff-5131-4297-8ce4-d3af35b9f96f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jul 07 10:23:58.877736 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: [pid: 103124|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jul 7 10:23:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:23:59.065508 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-ac3e543d-3d44-4bde-8317-45e61d67915a admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:23:59.066712 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 10:23:59.066712 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: warnings.warn(msg) Jul 07 10:23:59.068188 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-ac3e543d-3d44-4bde-8317-45e61d67915a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:23:59.068627 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-ac3e543d-3d44-4bde-8317-45e61d67915a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:23:59.069410 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-ac3e543d-3d44-4bde-8317-45e61d67915a admin admin] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:23:59.069839 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-ac3e543d-3d44-4bde-8317-45e61d67915a admin admin] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:23:59.092242 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-ac3e543d-3d44-4bde-8317-45e61d67915a admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077277 Jul 07 10:23:59.092718 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 39/76] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Jul 7 10:23:59 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:24:58.177113 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: Thu Jul 7 10:24:58 2022 - graceful shutdown triggered... Jul 07 10:24:58.177242 dv-cinder-822821-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 07 10:24:58.178056 dv-cinder-822821-4-iscsi devstack@n-api.service[103123]: Gracefully killing worker 1 (pid: 103123)... Jul 07 10:24:58.178429 dv-cinder-822821-4-iscsi devstack@n-api.service[103124]: Gracefully killing worker 2 (pid: 103124)... Jul 07 10:24:59.178866 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: worker 1 buried after 1 seconds Jul 07 10:24:59.179461 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: worker 2 buried after 1 seconds Jul 07 10:24:59.179461 dv-cinder-822821-4-iscsi devstack@n-api.service[103122]: goodbye to uWSGI. Jul 07 10:24:59.180457 dv-cinder-822821-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 07 10:24:59.180999 dv-cinder-822821-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 07 10:24:59.183788 dv-cinder-822821-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 07 10:24:59.193910 dv-cinder-822821-4-iscsi devstack@n-api.service[117626]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 07 10:24:59.195887 dv-cinder-822821-4-iscsi devstack@n-api.service[117626]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 7 10:24:59 2022] *** Jul 07 10:24:59.196055 dv-cinder-822821-4-iscsi devstack@n-api.service[117626]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 07 10:24:59.196175 dv-cinder-822821-4-iscsi devstack@n-api.service[117626]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 07 10:24:59.196278 dv-cinder-822821-4-iscsi devstack@n-api.service[117626]: nodename: dv-cinder-822821-4-iscsi Jul 07 10:24:59.196403 dv-cinder-822821-4-iscsi devstack@n-api.service[117626]: machine: x86_64 Jul 07 10:24:59.196507 dv-cinder-822821-4-iscsi devstack@n-api.service[117626]: clock source: unix Jul 07 10:24:59.196607 dv-cinder-822821-4-iscsi devstack@n-api.service[117626]: pcre jit disabled Jul 07 10:24:59.196723 dv-cinder-822821-4-iscsi devstack@n-api.service[117626]: detected number of CPU cores: 4 Jul 07 10:24:59.196836 dv-cinder-822821-4-iscsi devstack@n-api.service[117626]: current working directory: / Jul 07 10:24:59.196945 dv-cinder-822821-4-iscsi devstack@n-api.service[117626]: detected binary path: /usr/bin/uwsgi-core Jul 07 10:24:59.197060 dv-cinder-822821-4-iscsi devstack@n-api.service[117626]: your processes number limit is 47680 Jul 07 10:24:59.197170 dv-cinder-822821-4-iscsi devstack@n-api.service[117626]: your memory page size is 4096 bytes Jul 07 10:24:59.197291 dv-cinder-822821-4-iscsi devstack@n-api.service[117626]: detected max file descriptor number: 2048 Jul 07 10:24:59.197410 dv-cinder-822821-4-iscsi devstack@n-api.service[117626]: lock engine: pthread robust mutexes Jul 07 10:24:59.197691 dv-cinder-822821-4-iscsi devstack@n-api.service[117626]: thunder lock: enabled Jul 07 10:24:59.198114 dv-cinder-822821-4-iscsi devstack@n-api.service[117626]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 07 10:24:59.198114 dv-cinder-822821-4-iscsi devstack@n-api.service[117626]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 07 10:24:59.241615 dv-cinder-822821-4-iscsi devstack@n-api.service[117626]: Python main interpreter initialized at 0x563fe52959c0 Jul 07 10:24:59.241615 dv-cinder-822821-4-iscsi devstack@n-api.service[117626]: python threads support enabled Jul 07 10:24:59.241615 dv-cinder-822821-4-iscsi devstack@n-api.service[117626]: your server socket listen backlog is limited to 100 connections Jul 07 10:24:59.241615 dv-cinder-822821-4-iscsi devstack@n-api.service[117626]: your mercy for graceful operations on workers is 90 seconds Jul 07 10:24:59.242065 dv-cinder-822821-4-iscsi devstack@n-api.service[117626]: mapped 403077 bytes (393 KB) for 2 cores Jul 07 10:24:59.242065 dv-cinder-822821-4-iscsi devstack@n-api.service[117626]: *** Operational MODE: preforking *** Jul 07 10:24:59.242355 dv-cinder-822821-4-iscsi devstack@n-api.service[117626]: *** uWSGI is running in multiple interpreter mode *** Jul 07 10:24:59.242355 dv-cinder-822821-4-iscsi devstack@n-api.service[117626]: spawned uWSGI master process (pid: 117626) Jul 07 10:24:59.242554 dv-cinder-822821-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 07 10:24:59.243240 dv-cinder-822821-4-iscsi devstack@n-api.service[117626]: spawned uWSGI worker 1 (pid: 117646, cores: 1) Jul 07 10:24:59.246739 dv-cinder-822821-4-iscsi devstack@n-api.service[117626]: spawned uWSGI worker 2 (pid: 117647, cores: 1) Jul 07 10:24:59.246739 dv-cinder-822821-4-iscsi devstack@n-api.service[117626]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 07 10:24:59.899636 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 07 10:24:59.900779 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 07 10:25:01.085358 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 10:25:01.085358 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: from cryptography.utils import int_from_bytes Jul 07 10:25:01.086026 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 10:25:01.086026 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: from cryptography.utils import int_from_bytes Jul 07 10:25:01.094065 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 10:25:01.094065 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: from cryptography.utils import int_from_bytes Jul 07 10:25:01.094561 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 10:25:01.094561 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: from cryptography.utils import int_from_bytes Jul 07 10:25:03.400132 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 07 10:25:03.400695 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 07 10:25:03.400951 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 07 10:25:03.401274 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 07 10:25:03.401546 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 07 10:25:03.401928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.402258 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.402583 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.402907 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.403242 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.403587 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.403939 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.404263 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.404597 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.404861 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.405182 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.405510 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822821-4-iscsi {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.405838 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.406152 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.406464 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.406787 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.407094 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.407437 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.407734 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.408253 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.409699 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.409699 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.409699 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.409699 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.410103 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.410346 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.410574 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.410876 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.411199 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.411516 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.411929 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822821-4-iscsi {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.412254 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.412567 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.412889 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.413319 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.413625 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.413941 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.414267 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.414604 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.414918 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.415251 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.415575 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.415930 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.416260 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.416571 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.416886 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.417203 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.417528 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.417837 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.418148 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.418405 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.418721 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.419046 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.419402 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.419732 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.420012 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.420272 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.420594 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.420921 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.421237 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.421552 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.421867 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.422179 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.422490 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.422802 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.423115 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.423427 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.423807 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.424096 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.424423 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.424739 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.425062 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.425466 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.425725 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.426047 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.426391 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.426710 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.427027 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.427354 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.427678 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.428017 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.428326 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.428637 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.428961 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.429298 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.429605 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.429860 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.430172 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.430481 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.430801 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.431110 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.431419 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.431728 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.432056 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.432368 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.432677 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.432986 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.433295 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.433603 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.433906 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.434218 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.434527 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.435377 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.435700 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.436047 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.436363 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.436671 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.436980 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.437290 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.437616 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.437924 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.438230 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.438548 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.438857 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.439169 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.439490 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.439821 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.440137 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.440458 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.440763 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.441071 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.441389 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.441699 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.442006 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.442328 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.442620 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.442927 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.443234 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.443828 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.444139 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.444444 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.444765 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.445089 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.445400 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.445711 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.446020 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.446393 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.446685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.447021 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.447368 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.447685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.447980 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 07 10:25:03.448491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.448648 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 07 10:25:03.448801 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.448801 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.449095 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 07 10:25:03.449239 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.449381 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 07 10:25:03.449524 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.449674 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 07 10:25:03.449818 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.449975 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.450156 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.450305 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.451080 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.451243 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.451394 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.451558 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.451713 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.451887 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.452047 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.452198 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.452382 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.452537 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.452708 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.452863 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.453035 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.453187 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.453366 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.453518 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.453663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.453805 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.453966 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.454112 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822821-4-iscsi {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.454269 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.454412 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.454561 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.454561 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.454848 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.454848 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.455129 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.455273 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.455422 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.455575 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.455724 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.455907 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.456052 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.456195 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.456337 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.456479 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.456638 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.456809 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.456960 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.457103 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.457264 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.457466 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.457722 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.458493 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.458648 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.458801 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.459475 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.459586 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.459686 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.459801 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.459880 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.459880 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.460027 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.460099 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.460181 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.460253 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.460333 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.460410 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822821-4-iscsi {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.460504 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.460599 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.460691 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.460776 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.460869 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.461034 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.461212 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.461373 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.461526 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.461678 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.461822 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.461988 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.462144 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.462288 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.462436 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.462592 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.462744 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.462888 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.463039 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.463182 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.463332 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.463475 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.463674 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.463882 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.464038 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.464192 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.464335 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.464488 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.464632 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.464785 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.464936 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.465087 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.465237 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.465388 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.465538 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.465695 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.465846 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.465998 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.466149 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.466292 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.466444 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.466604 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.466835 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.467151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.467299 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.467451 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.467601 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.467784 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.468589 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.468778 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.468938 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.469092 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.469092 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.469400 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.469551 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.469696 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.469840 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.469985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.470147 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.470299 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.470449 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.471125 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.471282 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.471442 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.471607 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.471787 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.471945 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.472134 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.472291 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.472446 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.472590 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.472738 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.472889 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.473040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.473191 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.473346 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.473497 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.473652 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.473837 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.473986 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.474135 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.474292 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.474442 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.474585 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.474734 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.474884 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.474884 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.475178 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.475329 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.475514 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.475679 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.475865 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.476020 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.476173 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.476324 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.476482 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.476640 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.476790 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.476933 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.477089 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.477241 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.477384 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.477544 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.477694 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.477845 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.478001 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.478806 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.478963 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.479108 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.479264 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.479416 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.479574 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.479718 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.479884 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.480028 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.480195 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.480341 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.480497 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.480641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.480793 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.480946 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.481097 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.481250 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.481394 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.481536 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.481685 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.481836 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.481986 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.482162 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.482314 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.482457 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.482608 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.482751 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.482902 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.483055 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.483198 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.483342 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.483485 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.483642 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.483816 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.483979 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.484133 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.484284 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.484440 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.484592 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.484735 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.484887 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.485030 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.485173 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.485323 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.485474 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.485691 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.485845 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.485999 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.486149 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.486292 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.486434 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.486587 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.486738 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.486881 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.487037 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.487181 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.487181 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.487451 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.487594 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.487841 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.488016 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.488160 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.488785 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.489095 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.489244 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.489396 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.489551 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.489696 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.489847 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.489991 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.490142 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.490293 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.490483 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.490638 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.490784 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.490936 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.491086 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.491243 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.491394 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.491545 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.491689 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.491865 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.492019 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.492186 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.492331 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.492474 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.492769 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.492928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.493072 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.493225 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.493376 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.493520 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.493664 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.493814 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.493966 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.494124 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.494268 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.494418 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.494562 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.494715 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.494873 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.495024 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.495178 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.495322 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.495471 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.495614 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.495789 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.495941 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.496084 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 10:25:03.496244 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.496389 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.496541 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.496693 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.496837 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.496989 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.497134 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.497785 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.497941 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.497941 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.498224 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.498626 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.498963 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.499284 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.499447 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.499603 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.499805 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.499957 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.500100 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.500256 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.500409 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.500569 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.500720 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.500871 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.501014 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.508051 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.508277 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.508450 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.508886 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.509465 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.510727 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.510898 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.511057 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.511216 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.511362 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.511521 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.511666 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.511846 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.511995 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.512149 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.512313 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.512471 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.512615 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.512758 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.513490 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.513642 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.513852 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.514009 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.514161 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.514312 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.514456 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.514606 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.514758 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.514922 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.515073 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.515317 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.515468 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.515611 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.515807 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.515969 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.516114 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.522012 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.522012 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.522225 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.522317 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.522392 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.522472 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.522545 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.522624 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.522715 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.522790 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.522868 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.522942 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.523022 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.523096 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.523181 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.523254 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.523325 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.523403 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.523482 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.523556 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.523639 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.523713 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.523811 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.523886 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.523970 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.524044 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.524129 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.524203 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.524282 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.524363 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.525011 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.525011 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.525183 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.525258 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.525330 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.525415 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.525497 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.525578 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.525658 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.525736 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.525809 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.525880 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.525960 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.526034 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.526111 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.526184 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.526254 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.526333 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.526418 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.526492 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.526645 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.526735 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.526815 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.526888 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.526958 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.527035 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.527108 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.527187 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.527260 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.527330 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.527401 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.527472 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.527542 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.527542 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.527703 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.527807 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.527881 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.527952 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.528022 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.528107 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.528181 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.528252 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.528322 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.528393 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.528503 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.528589 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.528669 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.528741 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.528812 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.528882 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.528965 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.529038 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.529108 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.529186 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.529258 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.529343 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.529425 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.529506 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.529578 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.529656 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.529729 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.529800 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.529884 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.529957 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.530028 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.530098 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.530187 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.530272 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.530352 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.530432 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.530503 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.530574 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.530652 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.530739 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.530818 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.530949 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.531073 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.531202 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.531344 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.531490 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.531621 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.531770 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.531913 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.532045 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.532198 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.532338 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.532338 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.532553 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.532655 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.532743 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.532837 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.532923 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.533014 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.533101 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.533192 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.533285 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.533432 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.533524 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.533617 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.533710 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.533805 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.533891 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.533989 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.534076 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.534160 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.534244 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.534336 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.534441 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.534529 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.534613 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.534697 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.534789 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.534875 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.534973 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.535067 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.535154 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.535245 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.535337 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.535428 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.535579 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.535671 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.535783 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.535874 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.535967 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.536060 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.536060 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.536232 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.536326 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.536411 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.536545 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.536645 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.536732 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.536816 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.536909 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.536995 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.537134 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.537275 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.537414 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.537552 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.537682 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.537819 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.537916 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.538016 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.538103 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.538195 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.538289 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.538397 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.538492 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.538588 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.538675 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.538766 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.538852 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.538945 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.539040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.539135 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.539222 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.539307 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.539396 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.539396 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.539567 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.539653 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.539737 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.539875 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.540009 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.540099 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.540204 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.540299 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.540386 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.540470 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.540563 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.540656 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.540787 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.540875 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.540959 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.541044 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.541135 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.541230 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.541324 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.541417 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.541509 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.541602 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.541744 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.541843 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.541930 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.542022 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.542157 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.542295 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.542399 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.542546 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.542684 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.542781 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.542866 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.542958 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.543043 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.543141 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.543228 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.543313 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.543398 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.543491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.543590 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.543677 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.543778 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.543878 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.543878 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.544055 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.544172 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.544260 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.544352 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.544437 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.544521 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.544611 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.544706 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.544792 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.544876 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.544967 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.545053 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.545137 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.545285 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.545377 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.545463 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.545561 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.545705 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.545796 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.545890 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.545977 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.546061 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.546153 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.546238 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.546334 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.546420 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.546504 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.546588 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.546677 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.546770 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.546865 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.546966 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.547059 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.547144 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.547235 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.547320 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.547413 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.547533 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.547663 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.547820 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.547922 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.548009 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.548108 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.548195 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.548314 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.548453 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.548575 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.548702 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.548816 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.548939 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.549061 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.549182 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.549295 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.549421 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.549549 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.549663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.549774 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.549885 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.550006 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.550293 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.550413 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.550535 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.550655 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.550769 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.550888 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.551021 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.551135 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.551247 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.551366 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.551480 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.551611 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.551726 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.551861 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.551988 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.552102 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.552213 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.552339 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.552453 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.552564 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.552676 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.552795 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.552908 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.553034 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.553148 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.554012 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.554188 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.554339 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.554493 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.554650 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.554808 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.554914 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.555059 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.555151 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.555247 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.555346 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.555473 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.555637 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.555860 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.555954 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.556056 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.556145 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.556231 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.556315 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.556409 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.556538 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.556705 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.556860 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.557065 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.557161 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.557398 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.557524 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.557745 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.557880 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.558076 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.558196 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.558407 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.558561 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.558996 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.559202 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.559346 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.559498 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.559643 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.560371 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.560535 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.560692 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.560835 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.561049 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.561205 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.561349 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.561499 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.561639 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.561793 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.561941 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.562085 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.562224 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.562370 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.562509 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.562663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.562813 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.562954 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.563104 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.563254 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.563402 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.563925 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.564028 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.564179 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.564275 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.564370 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.564465 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.564563 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.564650 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.564743 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.564906 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.565107 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.565213 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.565435 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.565537 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.565751 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.565891 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.566077 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.566181 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.566405 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.566518 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.566715 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.566844 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.567024 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.567171 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.567337 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.567431 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.567647 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.567771 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.567993 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.568097 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.568321 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.568415 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.568886 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.568979 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.569202 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.569296 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.569515 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.569615 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.569825 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.569926 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.570133 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.570233 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.570442 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.570544 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.570754 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.570846 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.571062 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.571162 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.571378 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.571470 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.571690 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.571809 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.572036 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.572130 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.572355 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.572449 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.572662 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.572767 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.572979 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.573071 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.573290 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.573383 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.573598 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.573787 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.574049 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.574145 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.574240 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.574375 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.574528 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.574640 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.574839 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.574956 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.575148 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.575259 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.576024 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.576141 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.576350 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.576452 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.576660 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.576760 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.576979 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.577077 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.577292 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.577390 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.577616 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.577722 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.577930 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.578029 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.578243 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.578340 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.578550 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.578646 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.578854 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.578949 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.579168 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.579265 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.579478 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.579574 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.579831 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.579931 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.580122 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.580232 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.580435 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.580548 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.580743 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.580848 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.581049 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.581156 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.581356 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.581463 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.581668 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.581764 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.581978 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.582076 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.582306 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.582412 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.582666 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.582765 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.582920 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.583648 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.583766 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.583861 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.583956 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.584040 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.584040 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.584193 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.584275 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.584371 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.584495 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.584611 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.584891 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.585209 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.585330 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.585534 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.585632 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.585845 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.585952 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.586160 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.586269 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.586506 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.586607 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.586789 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.586897 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.587256 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.587583 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.587928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.588189 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.588350 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.588527 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.588678 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.588856 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.589015 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.589159 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.589308 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.589466 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.589610 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.589791 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.589949 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.590196 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.590355 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.590553 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.590700 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.591464 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.591715 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.591906 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.592054 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.592206 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.592351 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.592351 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.592719 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.592874 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.592874 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.593148 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.593291 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.593388 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.593578 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.593751 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.593847 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.593949 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.594038 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.594278 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.594429 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.594608 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.595010 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.595115 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.595276 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.595383 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.595613 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.595715 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.595950 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.596095 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.596277 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.596384 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.596632 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.596755 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.596953 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.597161 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.597293 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.597596 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.597739 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.599202 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.599317 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.599407 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.599490 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.599581 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.599656 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.599737 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.599835 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.599939 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.600105 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.600264 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.600264 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.600428 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.600503 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.600503 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.600665 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.600762 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.600848 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.600974 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.601193 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.601499 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.601854 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.602038 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.602202 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.602349 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.602491 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.602653 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.602872 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.603026 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.603186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.603186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.603457 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.603623 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.603796 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.603947 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.604097 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.604246 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.604393 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.604545 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.604685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.604850 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.605109 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.605458 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.605563 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.605664 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.605751 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.605850 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.605945 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.606038 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.606124 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.606216 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.606303 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.606453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.606548 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.606784 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.606892 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.607108 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.607212 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.607420 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.607518 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.607731 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.607935 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.608073 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.608166 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.608388 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.608487 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.608809 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.608914 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.609129 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.609259 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.609452 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.609571 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.609767 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.609898 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.610077 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.610232 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.610436 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.610546 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.610774 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.610871 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.611087 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.611183 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.611401 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.611505 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.611716 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.611929 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.612072 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.612168 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.612387 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.612488 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.612696 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.612789 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.613005 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.613133 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.613318 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.613459 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.613626 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.613771 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.613913 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.614181 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.614329 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.614484 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.614626 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.614809 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.614951 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.615140 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.615310 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.615568 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.615709 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.615865 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.616018 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.616164 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.616313 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.616466 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.616604 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.616753 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.616892 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.617038 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.617267 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.617420 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.617523 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.617612 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.617695 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.617861 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.618005 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.618147 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.618333 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.618428 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.618665 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.618756 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.618996 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.619335 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.619663 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.619842 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.620111 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.620231 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.620443 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.620574 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.620764 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.620885 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.621095 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.621217 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.621406 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.621526 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.621724 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.621852 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.622037 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.622167 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.622891 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.623043 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.623210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.623371 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.623500 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.623691 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.623837 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.624525 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.624645 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.624758 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.624889 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.624889 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.625126 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.625241 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.625353 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.625464 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.625593 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.625816 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.625954 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.626093 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.626233 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.626364 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.626499 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.626594 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.626809 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.626944 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.627120 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.627323 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.627451 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.627553 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.627788 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.627920 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.628109 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.628263 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.628422 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.628551 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.628740 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.628834 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.629056 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.629162 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.629370 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.629472 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.629683 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.629777 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.629998 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.630100 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.630311 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.630410 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.630625 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.630754 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.630940 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.631044 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.631254 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.631374 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.631567 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.631670 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.631929 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.632076 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.632421 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.632567 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.632657 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.632750 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.632924 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.633012 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.633223 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.633316 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.633546 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.633638 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.633861 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.633968 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.634177 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.634275 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.634491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.634620 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.634805 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.634907 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.635128 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.635221 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.635460 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.635555 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.635824 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.636014 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.636125 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.636241 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.636714 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.636830 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.636920 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.637004 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.637149 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.637254 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.637464 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.637616 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.637810 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.637953 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.638840 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.638942 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.639020 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.639109 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.639287 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.639460 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.639593 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.639797 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.639944 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.640144 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.640279 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.640474 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.640625 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.640803 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.640958 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.641140 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.641287 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.641460 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.641596 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.641791 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.641895 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.642116 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.642217 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.642443 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.642537 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.642767 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.642871 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.643095 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.643197 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.643409 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.643501 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.643717 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.643843 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.644055 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.644160 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.644365 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.644517 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.644673 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.644775 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.644982 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.645075 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.645290 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.645383 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.645600 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.645888 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.646021 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.646197 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.646296 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.646502 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.646845 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.646941 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.647037 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.647125 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.647219 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.647393 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.647540 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.647704 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.647886 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.648036 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.648133 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.648344 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.648439 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.648650 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.648796 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.648941 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.649033 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.649249 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.649351 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.649581 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.649675 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.649916 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.650020 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.650231 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.650326 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.650555 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.650648 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.650870 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.650972 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.651195 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.651289 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.651507 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.651607 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.651852 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.651964 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.652178 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.652271 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.652496 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.652633 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.652812 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.652906 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.653134 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.653226 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.653461 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.654060 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.654289 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.654452 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.654609 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.654772 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.654938 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.655087 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.655260 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.655401 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.655577 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.655716 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.655919 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.656075 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.656241 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.656408 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.656561 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.656737 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.656952 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.657056 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.657223 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.657364 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.657548 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.657688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.657868 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.658008 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.658188 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.658324 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.658510 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.658650 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.658963 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.659067 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.659274 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.659376 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.659596 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.659691 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.659953 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.660050 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.660271 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.660376 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.660594 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.660736 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.660915 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.661017 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.661246 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.661346 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.661569 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.661749 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.661883 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.661985 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.662198 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.662369 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.662499 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.662628 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.662814 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.662937 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.663157 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.663288 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.663476 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.663663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.663852 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.663973 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.664125 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.664247 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.664442 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.664582 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.664771 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.664989 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.665118 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 07 10:25:03.665351 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.665682 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.666020 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.666354 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.666680 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.667004 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.667340 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.667661 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.668006 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.668335 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.668737 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.669144 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.669836 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.670161 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.670478 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.670792 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.671115 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.671429 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.671790 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.672111 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.672428 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.672787 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.673067 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.673381 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.673723 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.674020 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.674331 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.674661 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.674973 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.675292 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.675604 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.675949 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.676263 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.676585 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.677259 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.677401 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.677996 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.678360 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.678698 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.679019 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.679352 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.679676 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.680111 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.680476 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.680804 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.681404 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.681753 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.682088 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.682439 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.682781 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.683097 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.683411 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.683726 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.684112 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.684418 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.684782 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.685108 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.685429 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.685747 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.686065 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.686381 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.686704 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.687019 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.687336 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.687653 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.688014 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.688330 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.688656 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.689021 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.689358 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.689748 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.690016 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.690343 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.690663 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.691556 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.691556 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.691981 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.691981 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.692281 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.692603 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.692916 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.693358 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.693943 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.694272 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.694601 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.694919 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.695333 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.695578 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.695932 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.696263 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.696633 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.696947 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.697268 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.697607 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.697935 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.698248 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.698557 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.698867 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.699186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.699513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.699856 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.700169 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.700530 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.700851 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.701163 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.701475 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.701785 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.702104 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.702410 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.702719 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.703029 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.703339 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.703651 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.703986 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.704297 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.704704 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.705021 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.705336 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.705821 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.706022 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.706250 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.706598 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.706938 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.707261 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.707659 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.707941 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.708397 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.708576 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.708901 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.709306 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.709796 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.709968 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.710194 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.710510 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.710828 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.711150 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.711467 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.711841 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.712130 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.712472 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.712805 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.713121 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.713456 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.713785 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.714115 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.714443 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.714763 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.715100 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.715417 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.715736 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.716619 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.716938 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.717258 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.717582 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.717908 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.718241 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.718663 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.718879 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.719213 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.719549 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.719986 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.720258 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.720616 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.720953 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.721276 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.721599 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.721913 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 10:25:03.722164 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 07 10:25:03.826779 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO dbcounter [None req-68fcecb4-54fe-43ef-a5eb-94f70df0a7ef None None] Registered counter for database nova_api Jul 07 10:25:03.848109 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_db.sqlalchemy.engines [None req-68fcecb4-54fe-43ef-a5eb-94f70df0a7ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117646) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 10:25:03.855341 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writer thread running {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 10:25:03.874762 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO dbcounter [None req-6322ef1f-ef42-459a-8152-500fb64a0121 None None] Registered counter for database nova_api Jul 07 10:25:03.895212 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_db.sqlalchemy.engines [None req-6322ef1f-ef42-459a-8152-500fb64a0121 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 10:25:03.905379 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writer thread running {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 10:25:03.912556 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.context [None req-68fcecb4-54fe-43ef-a5eb-94f70df0a7ef None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fd84c606-f924-4671-b7db-795cc76f382d(cell1) {{(pid=117646) load_cells /opt/stack/nova/nova/context.py:464}} Jul 07 10:25:03.916511 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-68fcecb4-54fe-43ef-a5eb-94f70df0a7ef None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:25:03.918118 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-68fcecb4-54fe-43ef-a5eb-94f70df0a7ef None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:25:03.918933 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-68fcecb4-54fe-43ef-a5eb-94f70df0a7ef None None] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:25:03.920935 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-68fcecb4-54fe-43ef-a5eb-94f70df0a7ef None None] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:25:03.922899 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO dbcounter [None req-68fcecb4-54fe-43ef-a5eb-94f70df0a7ef None None] Registered counter for database nova_cell0 Jul 07 10:25:03.927029 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO dbcounter [None req-68fcecb4-54fe-43ef-a5eb-94f70df0a7ef None None] Registered counter for database nova_cell1 Jul 07 10:25:03.935660 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_db.sqlalchemy.engines [None req-68fcecb4-54fe-43ef-a5eb-94f70df0a7ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117646) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 10:25:03.937098 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_db.sqlalchemy.engines [None req-68fcecb4-54fe-43ef-a5eb-94f70df0a7ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117646) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 10:25:03.943776 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writer thread running {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 10:25:03.945568 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writer thread running {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 10:25:03.962787 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.context [None req-6322ef1f-ef42-459a-8152-500fb64a0121 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fd84c606-f924-4671-b7db-795cc76f382d(cell1) {{(pid=117647) load_cells /opt/stack/nova/nova/context.py:464}} Jul 07 10:25:03.967370 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6322ef1f-ef42-459a-8152-500fb64a0121 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:25:03.969051 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6322ef1f-ef42-459a-8152-500fb64a0121 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:25:03.969872 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6322ef1f-ef42-459a-8152-500fb64a0121 None None] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:25:03.971858 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6322ef1f-ef42-459a-8152-500fb64a0121 None None] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:25:03.973831 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO dbcounter [None req-6322ef1f-ef42-459a-8152-500fb64a0121 None None] Registered counter for database nova_cell0 Jul 07 10:25:03.977886 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO dbcounter [None req-6322ef1f-ef42-459a-8152-500fb64a0121 None None] Registered counter for database nova_cell1 Jul 07 10:25:03.985409 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_db.sqlalchemy.engines [None req-6322ef1f-ef42-459a-8152-500fb64a0121 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 10:25:03.987169 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_db.sqlalchemy.engines [None req-6322ef1f-ef42-459a-8152-500fb64a0121 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 10:25:03.993091 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writer thread running {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 10:25:03.995164 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writer thread running {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 10:25:04.090641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO dbcounter [None req-68fcecb4-54fe-43ef-a5eb-94f70df0a7ef None None] Registered counter for database nova_cell0 Jul 07 10:25:04.097910 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_db.sqlalchemy.engines [None req-68fcecb4-54fe-43ef-a5eb-94f70df0a7ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117646) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 10:25:04.102329 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writer thread running {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 10:25:04.141575 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO dbcounter [None req-6322ef1f-ef42-459a-8152-500fb64a0121 None None] Registered counter for database nova_cell0 Jul 07 10:25:04.149713 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_db.sqlalchemy.engines [None req-6322ef1f-ef42-459a-8152-500fb64a0121 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 10:25:04.154161 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writer thread running {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 10:25:04.418577 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: WARNING keystonemiddleware.auth_token [None req-68fcecb4-54fe-43ef-a5eb-94f70df0a7ef None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 10:25:04.425916 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: WARNING keystonemiddleware.auth_token [None req-68fcecb4-54fe-43ef-a5eb-94f70df0a7ef None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 10:25:04.476271 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: WARNING keystonemiddleware.auth_token [None req-6322ef1f-ef42-459a-8152-500fb64a0121 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 10:25:04.484175 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: WARNING keystonemiddleware.auth_token [None req-6322ef1f-ef42-459a-8152-500fb64a0121 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 10:25:04.767556 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: WARNING keystonemiddleware.auth_token [None req-68fcecb4-54fe-43ef-a5eb-94f70df0a7ef None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 10:25:04.773623 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: WARNING keystonemiddleware.auth_token [None req-68fcecb4-54fe-43ef-a5eb-94f70df0a7ef None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 10:25:04.778865 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563fe52959c0 pid: 117646 (default app) Jul 07 10:25:04.826792 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: WARNING keystonemiddleware.auth_token [None req-6322ef1f-ef42-459a-8152-500fb64a0121 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 10:25:04.833133 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: WARNING keystonemiddleware.auth_token [None req-6322ef1f-ef42-459a-8152-500fb64a0121 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 10:25:04.838426 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563fe52959c0 pid: 117647 (default app) Jul 07 10:25:45.573568 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_api:SELECT=3 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:25:45.575201 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=3 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:25:45.576305 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell0:SELECT=3 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:25:45.577319 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell0:SELECT=3 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:25:45.715821 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=3 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:25:45.716802 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=3 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:25:45.717972 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=3 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:25:45.718795 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=3 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:25:47.227896 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-8aff1c81-f311-4d73-a8e8-3ab26b18aaa1 tempest-VolumesNegativeTest-368932832 tempest-VolumesNegativeTest-368932832-project] Action: 'create', calling method: .version_select at 0x7f9ea0502550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1312515269", "metadata": {"Type": "work"}}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:25:47.267958 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-8aff1c81-f311-4d73-a8e8-3ab26b18aaa1 tempest-VolumesNegativeTest-368932832 tempest-VolumesNegativeTest-368932832-project] Request method failure captured: Jul 07 10:25:47.267958 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 07 10:25:47.267958 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:25:47.267958 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:25:47.267958 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:25:47.267958 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 122 Jul 07 10:25:47.267958 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:25:47.267958 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:25:47.267958 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:25:47.267958 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:25:47.267958 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrSpW8b4hdn_C9Jo-fRGh4foAWHvKBklHHuhqXifs-D7jOoxRJzcVntuwYPP8Wt4jhpSyDeL1IIjN4ammr2BXuoXRpR95SOwkgSKcNbgqKsRrgP7dvtv5djAG4a1ucrFeXLrgf-iu79cYULgIUOhbOkuOsslejXnjWAcmOnb0CPLeT8 Jul 07 10:25:47.267958 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:25:47.267958 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:25:47.267958 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:25:47.267958 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:25:47.267958 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:25:47.267958 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:25:47.267958 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: 2c6a404439ce43e4b6210fcf354a5472 Jul 07 10:25:47.267958 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-VolumesNegativeTest-368932832 Jul 07 10:25:47.267958 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:25:47.267958 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:25:47.269486 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c6a404439ce43e4b6210fcf354a5472"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2c6a404439ce43e4b6210fcf354a5472"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c6a404439ce43e4b6210fcf354a5472"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2c6a404439ce43e4b6210fcf354a5472"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:25:47.269486 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-VolumesNegativeTest-368932832 Jul 07 10:25:47.269486 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: 2c6a404439ce43e4b6210fcf354a5472 Jul 07 10:25:47.269486 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-VolumesNegativeTest-368932832 Jul 07 10:25:47.269486 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-VolumesNegativeTest-368932832-project Jul 07 10:25:47.269486 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:25:47.269486 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:25:47.269486 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: b41ed92aeada435ea82e26acc6016578 Jul 07 10:25:47.269486 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-VolumesNegativeTest-368932832-project Jul 07 10:25:47.269486 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Jul 07 10:25:47.269486 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1312515269", "metadata": {"Type": "work"}}} Jul 07 10:25:47.269486 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: Jul 07 10:25:47.269486 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 07 10:25:47.270504 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1312515269', 'metadata': {'Type': 'work'}}}} Jul 07 10:25:47.270504 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:25:47.270504 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:25:47.270504 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 07 10:25:47.270504 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 07 10:25:47.270504 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 07 10:25:47.270504 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise error Jul 07 10:25:47.270504 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 07 10:25:47.270504 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:47.270504 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 07 10:25:47.270504 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 07 10:25:47.270504 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:47.270504 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 07 10:25:47.270504 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi '#$%' Jul 07 10:25:47.270504 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:47.270504 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:25:47.270504 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:47.270504 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:25:47.270504 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:25:47.270504 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:25:47.270504 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:25:47.270504 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:25:47.272028 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 10:25:47.272028 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 10:25:47.272028 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:25:47.272028 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:25:47.272028 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 07 10:25:47.272028 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 07 10:25:47.272028 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 07 10:25:47.272028 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 07 10:25:47.272028 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 07 10:25:47.272028 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 07 10:25:47.272028 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 07 10:25:47.272028 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:47.272028 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:25:47.272028 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:47.272028 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:25:47.272028 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:25:47.272028 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:25:47.272028 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 07 10:25:47.272028 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 07 10:25:47.273146 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 07 10:25:47.273146 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:47.277397 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-8aff1c81-f311-4d73-a8e8-3ab26b18aaa1 tempest-VolumesNegativeTest-368932832 tempest-VolumesNegativeTest-368932832-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:25:47.279194 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-8aff1c81-f311-4d73-a8e8-3ab26b18aaa1 tempest-VolumesNegativeTest-368932832 tempest-VolumesNegativeTest-368932832-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.726060 Jul 07 10:25:47.280493 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1155 bytes} [Thu Jul 7 10:25:45 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1729 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 07 10:25:47.292470 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-9f67da61-fad4-4a36-86c1-67003e653a2a tempest-VolumesNegativeTest-368932832 tempest-VolumesNegativeTest-368932832-project] Action: 'create', calling method: .version_select at 0x7f9ea048b8b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-121519583", "metadata": {"Type": "work"}}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:25:47.299323 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-9f67da61-fad4-4a36-86c1-67003e653a2a tempest-VolumesNegativeTest-368932832 tempest-VolumesNegativeTest-368932832-project] Request method failure captured: Jul 07 10:25:47.299323 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 07 10:25:47.299323 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:25:47.299323 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:25:47.299323 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:25:47.299323 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 119 Jul 07 10:25:47.299323 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:25:47.299323 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:25:47.299323 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:25:47.299323 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:25:47.299323 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrSpW8b4hdn_C9Jo-fRGh4foAWHvKBklHHuhqXifs-D7jOoxRJzcVntuwYPP8Wt4jhpSyDeL1IIjN4ammr2BXuoXRpR95SOwkgSKcNbgqKsRrgP7dvtv5djAG4a1ucrFeXLrgf-iu79cYULgIUOhbOkuOsslejXnjWAcmOnb0CPLeT8 Jul 07 10:25:47.299323 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:25:47.299323 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:25:47.299323 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:25:47.299323 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:25:47.299323 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:25:47.299323 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:25:47.299323 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: 2c6a404439ce43e4b6210fcf354a5472 Jul 07 10:25:47.299323 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-VolumesNegativeTest-368932832 Jul 07 10:25:47.299323 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:25:47.299323 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:25:47.300954 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c6a404439ce43e4b6210fcf354a5472"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2c6a404439ce43e4b6210fcf354a5472"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c6a404439ce43e4b6210fcf354a5472"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2c6a404439ce43e4b6210fcf354a5472"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:25:47.300954 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-VolumesNegativeTest-368932832 Jul 07 10:25:47.300954 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: 2c6a404439ce43e4b6210fcf354a5472 Jul 07 10:25:47.300954 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-VolumesNegativeTest-368932832 Jul 07 10:25:47.300954 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-VolumesNegativeTest-368932832-project Jul 07 10:25:47.300954 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:25:47.300954 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:25:47.300954 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: b41ed92aeada435ea82e26acc6016578 Jul 07 10:25:47.300954 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-VolumesNegativeTest-368932832-project Jul 07 10:25:47.300954 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Jul 07 10:25:47.300954 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-121519583", "metadata": {"Type": "work"}}} Jul 07 10:25:47.300954 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: Jul 07 10:25:47.300954 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 07 10:25:47.302032 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-121519583', 'metadata': {'Type': 'work'}}}} Jul 07 10:25:47.302032 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:25:47.302032 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:25:47.302032 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 07 10:25:47.302032 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 07 10:25:47.302032 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 07 10:25:47.302032 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise error Jul 07 10:25:47.302032 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 07 10:25:47.302032 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:47.302032 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 07 10:25:47.302032 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 07 10:25:47.302032 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:47.302032 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 07 10:25:47.302032 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi '0' Jul 07 10:25:47.302032 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:47.302032 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:25:47.302032 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:47.302032 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:25:47.302032 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:25:47.302032 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:25:47.302032 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:25:47.302032 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:25:47.303663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 10:25:47.303663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 10:25:47.303663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:25:47.303663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:25:47.303663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 07 10:25:47.303663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 07 10:25:47.303663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 07 10:25:47.303663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 07 10:25:47.303663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 07 10:25:47.303663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 07 10:25:47.303663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 07 10:25:47.303663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:47.303663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:25:47.303663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:47.303663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:25:47.303663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:25:47.303663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:25:47.303663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 07 10:25:47.303663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 07 10:25:47.305110 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 07 10:25:47.305110 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:47.306935 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-9f67da61-fad4-4a36-86c1-67003e653a2a tempest-VolumesNegativeTest-368932832 tempest-VolumesNegativeTest-368932832-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:25:47.308040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-9f67da61-fad4-4a36-86c1-67003e653a2a tempest-VolumesNegativeTest-368932832 tempest-VolumesNegativeTest-368932832-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.020653 Jul 07 10:25:47.309564 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 2/2] 10.222.0.16 () {60 vars in 1155 bytes} [Thu Jul 7 10:25:47 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 07 10:25:47.321705 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-22bc949f-2f89-4d9b-be96-7ee6616b0720 tempest-VolumesNegativeTest-368932832 tempest-VolumesNegativeTest-368932832-project] Action: 'create', calling method: .version_select at 0x7f9ea05028b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-653643832", "metadata": {"Type": "work"}}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:25:47.330946 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-22bc949f-2f89-4d9b-be96-7ee6616b0720 tempest-VolumesNegativeTest-368932832 tempest-VolumesNegativeTest-368932832-project] Request method failure captured: Jul 07 10:25:47.330946 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 07 10:25:47.330946 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:25:47.330946 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:25:47.330946 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:25:47.330946 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 118 Jul 07 10:25:47.330946 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:25:47.330946 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:25:47.330946 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:25:47.330946 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:25:47.330946 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrSpW8b4hdn_C9Jo-fRGh4foAWHvKBklHHuhqXifs-D7jOoxRJzcVntuwYPP8Wt4jhpSyDeL1IIjN4ammr2BXuoXRpR95SOwkgSKcNbgqKsRrgP7dvtv5djAG4a1ucrFeXLrgf-iu79cYULgIUOhbOkuOsslejXnjWAcmOnb0CPLeT8 Jul 07 10:25:47.330946 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:25:47.330946 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:25:47.330946 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:25:47.330946 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:25:47.330946 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:25:47.330946 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:25:47.330946 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: 2c6a404439ce43e4b6210fcf354a5472 Jul 07 10:25:47.330946 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-VolumesNegativeTest-368932832 Jul 07 10:25:47.330946 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:25:47.330946 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:25:47.332484 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c6a404439ce43e4b6210fcf354a5472"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2c6a404439ce43e4b6210fcf354a5472"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c6a404439ce43e4b6210fcf354a5472"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2c6a404439ce43e4b6210fcf354a5472"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:25:47.332484 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-VolumesNegativeTest-368932832 Jul 07 10:25:47.332484 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: 2c6a404439ce43e4b6210fcf354a5472 Jul 07 10:25:47.332484 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-VolumesNegativeTest-368932832 Jul 07 10:25:47.332484 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-VolumesNegativeTest-368932832-project Jul 07 10:25:47.332484 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:25:47.332484 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:25:47.332484 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: b41ed92aeada435ea82e26acc6016578 Jul 07 10:25:47.332484 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-VolumesNegativeTest-368932832-project Jul 07 10:25:47.332484 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Jul 07 10:25:47.332484 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-653643832", "metadata": {"Type": "work"}}} Jul 07 10:25:47.332484 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: Jul 07 10:25:47.332484 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 07 10:25:47.333415 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-653643832', 'metadata': {'Type': 'work'}}}} Jul 07 10:25:47.333415 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:25:47.333415 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:25:47.333415 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 07 10:25:47.333415 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 07 10:25:47.333415 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 07 10:25:47.333415 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise error Jul 07 10:25:47.333415 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 07 10:25:47.333415 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:47.333415 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 07 10:25:47.333415 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 07 10:25:47.333415 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:47.333415 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 07 10:25:47.333415 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi '' Jul 07 10:25:47.333415 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:47.333415 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:25:47.333415 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:47.333415 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:25:47.333415 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:25:47.333415 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:25:47.333415 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:25:47.333415 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:25:47.334985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 10:25:47.334985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 10:25:47.334985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:25:47.334985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:25:47.334985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 07 10:25:47.334985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 07 10:25:47.334985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 07 10:25:47.334985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 07 10:25:47.334985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 07 10:25:47.334985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 07 10:25:47.334985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 07 10:25:47.334985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:47.334985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:25:47.334985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:47.334985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:25:47.334985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:25:47.334985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:25:47.334985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 07 10:25:47.334985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 07 10:25:47.336345 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 07 10:25:47.336345 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:47.339882 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-22bc949f-2f89-4d9b-be96-7ee6616b0720 tempest-VolumesNegativeTest-368932832 tempest-VolumesNegativeTest-368932832-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:25:47.351374 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-22bc949f-2f89-4d9b-be96-7ee6616b0720 tempest-VolumesNegativeTest-368932832 tempest-VolumesNegativeTest-368932832-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.030639 Jul 07 10:25:47.352266 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 3/3] 10.222.0.16 () {60 vars in 1155 bytes} [Thu Jul 7 10:25:47 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 07 10:25:47.362681 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-49489c36-007b-4c8a-9e02-0dd43ae6c728 tempest-VolumesNegativeTest-368932832 tempest-VolumesNegativeTest-368932832-project] Calling method '.version_select at 0x7f9ea042f5e0>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:25:47.904285 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-7541e8bc-1483-4d12-8f9c-313d2492cdfc tempest-VolumesGetTestJSON-52621927 tempest-VolumesGetTestJSON-52621927-project] Action: 'create', calling method: .version_select at 0x7f9ea05035e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-121816492", "metadata": {"Type": "work"}}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:25:48.051584 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.wsgi [None req-49489c36-007b-4c8a-9e02-0dd43ae6c728 tempest-VolumesNegativeTest-368932832 tempest-VolumesNegativeTest-368932832-project] HTTP exception thrown: Volume tempest-invalid-1797125971 could not be found. Jul 07 10:25:48.055445 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-49489c36-007b-4c8a-9e02-0dd43ae6c728 tempest-VolumesNegativeTest-368932832 tempest-VolumesNegativeTest-368932832-project] Request method failure captured: Jul 07 10:25:48.055445 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1797125971 HTTP/1.1 Jul 07 10:25:48.055445 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:25:48.055445 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:25:48.055445 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:25:48.055445 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 0 Jul 07 10:25:48.055445 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:25:48.055445 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:25:48.055445 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:25:48.055445 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:25:48.055445 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrSpW8b4hdn_C9Jo-fRGh4foAWHvKBklHHuhqXifs-D7jOoxRJzcVntuwYPP8Wt4jhpSyDeL1IIjN4ammr2BXuoXRpR95SOwkgSKcNbgqKsRrgP7dvtv5djAG4a1ucrFeXLrgf-iu79cYULgIUOhbOkuOsslejXnjWAcmOnb0CPLeT8 Jul 07 10:25:48.055445 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:25:48.055445 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:25:48.055445 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:25:48.055445 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:25:48.055445 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:25:48.055445 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:25:48.055445 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: 2c6a404439ce43e4b6210fcf354a5472 Jul 07 10:25:48.055445 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-VolumesNegativeTest-368932832 Jul 07 10:25:48.055445 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:25:48.055445 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:25:48.056814 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c6a404439ce43e4b6210fcf354a5472"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2c6a404439ce43e4b6210fcf354a5472"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c6a404439ce43e4b6210fcf354a5472"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2c6a404439ce43e4b6210fcf354a5472"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:25:48.056814 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-VolumesNegativeTest-368932832 Jul 07 10:25:48.056814 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: 2c6a404439ce43e4b6210fcf354a5472 Jul 07 10:25:48.056814 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-VolumesNegativeTest-368932832 Jul 07 10:25:48.056814 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-VolumesNegativeTest-368932832-project Jul 07 10:25:48.056814 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:25:48.056814 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:25:48.056814 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: b41ed92aeada435ea82e26acc6016578 Jul 07 10:25:48.056814 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-VolumesNegativeTest-368932832-project Jul 07 10:25:48.056814 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: Jul 07 10:25:48.056814 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Volume tempest-invalid-1797125971 could not be found. Jul 07 10:25:48.056814 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'id': 'tempest-invalid-1797125971'} Jul 07 10:25:48.056814 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:25:48.057591 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:25:48.057591 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 10:25:48.057591 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 10:25:48.057591 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 07 10:25:48.057591 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 07 10:25:48.057591 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 07 10:25:48.057591 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 07 10:25:48.057591 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 07 10:25:48.057591 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 07 10:25:48.057591 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 07 10:25:48.057591 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 07 10:25:48.057591 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 10:25:48.057591 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 10:25:48.057591 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 10:25:48.057591 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 10:25:48.057591 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1797125971 could not be found. (HTTP 404) (Request-ID: req-24140603-c657-40a4-81bd-0fa94b490e9c) Jul 07 10:25:48.057591 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:48.057591 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:25:48.057591 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:48.058846 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:25:48.058846 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 07 10:25:48.058846 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 07 10:25:48.058846 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 10:25:48.058846 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 10:25:48.058846 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 07 10:25:48.058846 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 07 10:25:48.058846 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 10:25:48.058846 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 10:25:48.058846 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 10:25:48.058846 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 10:25:48.058846 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 07 10:25:48.058846 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 07 10:25:48.058846 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 07 10:25:48.058846 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 07 10:25:48.058846 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 07 10:25:48.058846 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 07 10:25:48.058846 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 07 10:25:48.058846 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 07 10:25:48.060619 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 10:25:48.060619 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 10:25:48.060619 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 10:25:48.060619 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 10:25:48.060619 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1797125971 could not be found. Jul 07 10:25:48.060619 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:48.060619 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:25:48.060619 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:48.060619 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:25:48.060619 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:25:48.060619 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:25:48.060619 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:25:48.060619 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:25:48.060619 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 10:25:48.060619 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 10:25:48.060619 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:25:48.060619 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:25:48.060619 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 07 10:25:48.060619 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:25:48.060619 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1797125971 could not be found. Jul 07 10:25:48.061810 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:48.061810 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:25:48.061810 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:48.061810 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:25:48.061810 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:25:48.061810 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:25:48.061810 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:25:48.061810 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:25:48.061810 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1797125971 could not be found. Jul 07 10:25:48.061810 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:48.061810 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-49489c36-007b-4c8a-9e02-0dd43ae6c728 tempest-VolumesNegativeTest-368932832 tempest-VolumesNegativeTest-368932832-project] Returning 404 to user: Volume tempest-invalid-1797125971 could not be found. {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:25:48.061810 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-49489c36-007b-4c8a-9e02-0dd43ae6c728 tempest-VolumesNegativeTest-368932832 tempest-VolumesNegativeTest-368932832-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1797125971" status: 404 len: 99 microversion: 2.1 time: 0.698221 Jul 07 10:25:48.061810 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 4/4] 10.222.0.16 () {58 vars in 1217 bytes} [Thu Jul 7 10:25:47 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1797125971 => generated 99 bytes in 699 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 07 10:25:48.071164 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-bda22e84-e88b-4133-a390-db83acdd69e2 tempest-VolumesNegativeTest-368932832 tempest-VolumesNegativeTest-368932832-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004210 Jul 07 10:25:48.071669 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 5/5] 10.222.0.16 () {58 vars in 1139 bytes} [Thu Jul 7 10:25:48 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 07 10:25:48.097747 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-5df0e9d7-a4c7-4e8d-b25e-c4d8e7bb009d tempest-VolumesNegativeTest-368932832 tempest-VolumesNegativeTest-368932832-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.017464 Jul 07 10:25:48.115163 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 6/6] 10.222.0.16 () {58 vars in 1136 bytes} [Thu Jul 7 10:25:48 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 07 10:25:48.125098 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-50d81eba-008a-454e-9609-b8320cf48301 tempest-VolumesNegativeTest-368932832 tempest-VolumesNegativeTest-368932832-project] Calling method '.version_select at 0x7f9ea035c8b0>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:25:48.576231 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.wsgi [None req-50d81eba-008a-454e-9609-b8320cf48301 tempest-VolumesNegativeTest-368932832 tempest-VolumesNegativeTest-368932832-project] HTTP exception thrown: Volume b3359184-82dd-453b-9d3a-dbae1232da17 could not be found. Jul 07 10:25:48.578914 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-50d81eba-008a-454e-9609-b8320cf48301 tempest-VolumesNegativeTest-368932832 tempest-VolumesNegativeTest-368932832-project] Request method failure captured: Jul 07 10:25:48.578914 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: DELETE /compute/v2.1/os-volumes/b3359184-82dd-453b-9d3a-dbae1232da17 HTTP/1.1 Jul 07 10:25:48.578914 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:25:48.578914 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:25:48.578914 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:25:48.578914 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 0 Jul 07 10:25:48.578914 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:25:48.578914 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:25:48.578914 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:25:48.578914 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:25:48.578914 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrSpW8b4hdn_C9Jo-fRGh4foAWHvKBklHHuhqXifs-D7jOoxRJzcVntuwYPP8Wt4jhpSyDeL1IIjN4ammr2BXuoXRpR95SOwkgSKcNbgqKsRrgP7dvtv5djAG4a1ucrFeXLrgf-iu79cYULgIUOhbOkuOsslejXnjWAcmOnb0CPLeT8 Jul 07 10:25:48.578914 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:25:48.578914 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:25:48.578914 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:25:48.578914 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:25:48.578914 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:25:48.578914 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:25:48.578914 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: 2c6a404439ce43e4b6210fcf354a5472 Jul 07 10:25:48.578914 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-VolumesNegativeTest-368932832 Jul 07 10:25:48.578914 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:25:48.578914 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:25:48.580167 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c6a404439ce43e4b6210fcf354a5472"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2c6a404439ce43e4b6210fcf354a5472"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c6a404439ce43e4b6210fcf354a5472"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2c6a404439ce43e4b6210fcf354a5472"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:25:48.580167 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-VolumesNegativeTest-368932832 Jul 07 10:25:48.580167 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: 2c6a404439ce43e4b6210fcf354a5472 Jul 07 10:25:48.580167 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-VolumesNegativeTest-368932832 Jul 07 10:25:48.580167 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-VolumesNegativeTest-368932832-project Jul 07 10:25:48.580167 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:25:48.580167 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:25:48.580167 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: b41ed92aeada435ea82e26acc6016578 Jul 07 10:25:48.580167 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-VolumesNegativeTest-368932832-project Jul 07 10:25:48.580167 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: Jul 07 10:25:48.580167 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Volume b3359184-82dd-453b-9d3a-dbae1232da17 could not be found. Jul 07 10:25:48.580167 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'id': 'b3359184-82dd-453b-9d3a-dbae1232da17'} Jul 07 10:25:48.580167 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:25:48.581094 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:25:48.581094 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 10:25:48.581094 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 10:25:48.581094 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 07 10:25:48.581094 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 07 10:25:48.581094 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 07 10:25:48.581094 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 07 10:25:48.581094 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 07 10:25:48.581094 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 07 10:25:48.581094 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 07 10:25:48.581094 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 07 10:25:48.581094 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 10:25:48.581094 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 10:25:48.581094 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 10:25:48.581094 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 10:25:48.581094 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b3359184-82dd-453b-9d3a-dbae1232da17 could not be found. (HTTP 404) (Request-ID: req-1607ede6-5549-4caf-b432-6713319df087) Jul 07 10:25:48.581094 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:48.581094 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:25:48.581094 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:48.582151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:25:48.582151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 07 10:25:48.582151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 07 10:25:48.582151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 10:25:48.582151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 10:25:48.582151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 07 10:25:48.582151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 07 10:25:48.582151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 10:25:48.582151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 10:25:48.582151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 10:25:48.582151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 10:25:48.582151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 07 10:25:48.582151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 07 10:25:48.582151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 07 10:25:48.582151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 07 10:25:48.582151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 07 10:25:48.582151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 07 10:25:48.582151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 07 10:25:48.582151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 07 10:25:48.585789 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 10:25:48.585789 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 10:25:48.585789 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 10:25:48.585789 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 10:25:48.585789 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b3359184-82dd-453b-9d3a-dbae1232da17 could not be found. Jul 07 10:25:48.585789 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:48.585789 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:25:48.585789 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:48.585789 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:25:48.585789 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:25:48.585789 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:25:48.585789 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:25:48.585789 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:25:48.585789 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 10:25:48.585789 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 10:25:48.585789 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:25:48.585789 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:25:48.585789 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 07 10:25:48.585789 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:25:48.589175 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b3359184-82dd-453b-9d3a-dbae1232da17 could not be found. Jul 07 10:25:48.589175 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:48.589175 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:25:48.589175 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:48.589175 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:25:48.589175 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:25:48.589175 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:25:48.589175 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:25:48.589175 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:25:48.589175 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b3359184-82dd-453b-9d3a-dbae1232da17 could not be found. Jul 07 10:25:48.589175 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:48.589175 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-50d81eba-008a-454e-9609-b8320cf48301 tempest-VolumesNegativeTest-368932832 tempest-VolumesNegativeTest-368932832-project] Returning 404 to user: Volume b3359184-82dd-453b-9d3a-dbae1232da17 could not be found. {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:25:48.589175 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-50d81eba-008a-454e-9609-b8320cf48301 tempest-VolumesNegativeTest-368932832 tempest-VolumesNegativeTest-368932832-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/b3359184-82dd-453b-9d3a-dbae1232da17" status: 404 len: 109 microversion: 2.1 time: 0.461811 Jul 07 10:25:48.589175 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 7/7] 10.222.0.16 () {58 vars in 1247 bytes} [Thu Jul 7 10:25:48 2022] DELETE /compute/v2.1/os-volumes/b3359184-82dd-453b-9d3a-dbae1232da17 => generated 109 bytes in 463 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:25:48.592534 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-200d5749-f3be-4cfa-a9ab-f1419c10d44b tempest-VolumesNegativeTest-368932832 tempest-VolumesNegativeTest-368932832-project] Calling method '.version_select at 0x7f9ea035c310>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:25:48.796120 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.wsgi [None req-200d5749-f3be-4cfa-a9ab-f1419c10d44b tempest-VolumesNegativeTest-368932832 tempest-VolumesNegativeTest-368932832-project] HTTP exception thrown: Volume 61dcc101-9305-4887-9114-f0b29cc24064 could not be found. Jul 07 10:25:48.798888 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-200d5749-f3be-4cfa-a9ab-f1419c10d44b tempest-VolumesNegativeTest-368932832 tempest-VolumesNegativeTest-368932832-project] Request method failure captured: Jul 07 10:25:48.798888 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: GET /compute/v2.1/os-volumes/61dcc101-9305-4887-9114-f0b29cc24064 HTTP/1.1 Jul 07 10:25:48.798888 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:25:48.798888 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:25:48.798888 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:25:48.798888 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 0 Jul 07 10:25:48.798888 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:25:48.798888 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:25:48.798888 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:25:48.798888 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:25:48.798888 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrSpW8b4hdn_C9Jo-fRGh4foAWHvKBklHHuhqXifs-D7jOoxRJzcVntuwYPP8Wt4jhpSyDeL1IIjN4ammr2BXuoXRpR95SOwkgSKcNbgqKsRrgP7dvtv5djAG4a1ucrFeXLrgf-iu79cYULgIUOhbOkuOsslejXnjWAcmOnb0CPLeT8 Jul 07 10:25:48.798888 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:25:48.798888 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:25:48.798888 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:25:48.798888 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:25:48.798888 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:25:48.798888 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:25:48.798888 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: 2c6a404439ce43e4b6210fcf354a5472 Jul 07 10:25:48.798888 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-VolumesNegativeTest-368932832 Jul 07 10:25:48.798888 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:25:48.798888 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:25:48.800301 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c6a404439ce43e4b6210fcf354a5472"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2c6a404439ce43e4b6210fcf354a5472"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2c6a404439ce43e4b6210fcf354a5472"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2c6a404439ce43e4b6210fcf354a5472"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:25:48.800301 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-VolumesNegativeTest-368932832 Jul 07 10:25:48.800301 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: 2c6a404439ce43e4b6210fcf354a5472 Jul 07 10:25:48.800301 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-VolumesNegativeTest-368932832 Jul 07 10:25:48.800301 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-VolumesNegativeTest-368932832-project Jul 07 10:25:48.800301 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:25:48.800301 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:25:48.800301 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: b41ed92aeada435ea82e26acc6016578 Jul 07 10:25:48.800301 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-VolumesNegativeTest-368932832-project Jul 07 10:25:48.800301 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: Jul 07 10:25:48.800301 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Volume 61dcc101-9305-4887-9114-f0b29cc24064 could not be found. Jul 07 10:25:48.800301 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'id': '61dcc101-9305-4887-9114-f0b29cc24064'} Jul 07 10:25:48.800301 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:25:48.801069 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:25:48.801069 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 10:25:48.801069 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 10:25:48.801069 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 10:25:48.801069 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 10:25:48.801069 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 10:25:48.801069 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 10:25:48.801069 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 10:25:48.801069 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 10:25:48.801069 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 10:25:48.801069 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 10:25:48.801069 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 10:25:48.801069 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 10:25:48.801069 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 10:25:48.801069 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 10:25:48.801069 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 61dcc101-9305-4887-9114-f0b29cc24064 could not be found. (HTTP 404) (Request-ID: req-ed1b0d53-bf6c-4714-9992-f604cd475d8e) Jul 07 10:25:48.801069 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:48.801069 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:25:48.801069 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:48.802211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:25:48.802211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 07 10:25:48.802211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 07 10:25:48.802211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 10:25:48.802211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 10:25:48.802211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 07 10:25:48.802211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 07 10:25:48.802211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 10:25:48.802211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 10:25:48.802211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 10:25:48.802211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 10:25:48.802211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 10:25:48.802211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 10:25:48.802211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 10:25:48.802211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 10:25:48.802211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 10:25:48.802211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 10:25:48.802211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 10:25:48.802211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 10:25:48.803442 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 10:25:48.803442 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 10:25:48.803442 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 10:25:48.803442 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 10:25:48.803442 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 61dcc101-9305-4887-9114-f0b29cc24064 could not be found. Jul 07 10:25:48.803442 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:48.803442 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:25:48.803442 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:48.803442 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:25:48.803442 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:25:48.803442 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:25:48.803442 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:25:48.803442 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:25:48.803442 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 10:25:48.803442 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 10:25:48.803442 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:25:48.803442 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:25:48.803442 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 07 10:25:48.803442 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:25:48.806056 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 61dcc101-9305-4887-9114-f0b29cc24064 could not be found. Jul 07 10:25:48.806056 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:48.806056 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:25:48.806056 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:48.806056 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:25:48.806056 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:25:48.806056 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:25:48.806056 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:25:48.806056 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:25:48.806056 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 61dcc101-9305-4887-9114-f0b29cc24064 could not be found. Jul 07 10:25:48.806056 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:25:48.809262 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-200d5749-f3be-4cfa-a9ab-f1419c10d44b tempest-VolumesNegativeTest-368932832 tempest-VolumesNegativeTest-368932832-project] Returning 404 to user: Volume 61dcc101-9305-4887-9114-f0b29cc24064 could not be found. {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:25:48.810839 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-200d5749-f3be-4cfa-a9ab-f1419c10d44b tempest-VolumesNegativeTest-368932832 tempest-VolumesNegativeTest-368932832-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/61dcc101-9305-4887-9114-f0b29cc24064" status: 404 len: 109 microversion: 2.1 time: 0.223147 Jul 07 10:25:48.811874 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 8/8] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jul 7 10:25:48 2022] GET /compute/v2.1/os-volumes/61dcc101-9305-4887-9114-f0b29cc24064 => generated 109 bytes in 225 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 07 10:25:49.292957 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-7541e8bc-1483-4d12-8f9c-313d2492cdfc tempest-VolumesGetTestJSON-52621927 tempest-VolumesGetTestJSON-52621927-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.589969 Jul 07 10:25:49.293682 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 1/9] 10.222.0.16 () {60 vars in 1155 bytes} [Thu Jul 7 10:25:45 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3593 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 07 10:25:49.308068 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a06dd663-5ca7-4707-8376-6e15222bc335 tempest-VolumesGetTestJSON-52621927 tempest-VolumesGetTestJSON-52621927-project] Calling method '.version_select at 0x7f9ea035cb80>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:25:49.460101 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-a06dd663-5ca7-4707-8376-6e15222bc335 tempest-VolumesGetTestJSON-52621927 tempest-VolumesGetTestJSON-52621927-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/7936198a-9f3a-4d79-873d-c7b4914bab1c" status: 200 len: 352 microversion: 2.1 time: 0.157882 Jul 07 10:25:49.469384 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 9/10] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jul 7 10:25:49 2022] GET /compute/v2.1/os-volumes/7936198a-9f3a-4d79-873d-c7b4914bab1c => generated 352 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:25:50.476895 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-dde30122-a1e3-4b86-8eda-b4f1c694c935 tempest-VolumesGetTestJSON-52621927 tempest-VolumesGetTestJSON-52621927-project] Calling method '.version_select at 0x7f9ea03c84c0>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:25:50.592882 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-dde30122-a1e3-4b86-8eda-b4f1c694c935 tempest-VolumesGetTestJSON-52621927 tempest-VolumesGetTestJSON-52621927-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/7936198a-9f3a-4d79-873d-c7b4914bab1c" status: 200 len: 353 microversion: 2.1 time: 0.120103 Jul 07 10:25:50.593452 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 2/11] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jul 7 10:25:50 2022] GET /compute/v2.1/os-volumes/7936198a-9f3a-4d79-873d-c7b4914bab1c => generated 353 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:25:50.604850 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-4ef8938a-e9e6-4558-a810-e885c5f7c147 tempest-VolumesGetTestJSON-52621927 tempest-VolumesGetTestJSON-52621927-project] Calling method '.version_select at 0x7f9ea035c040>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:25:50.731983 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-4ef8938a-e9e6-4558-a810-e885c5f7c147 tempest-VolumesGetTestJSON-52621927 tempest-VolumesGetTestJSON-52621927-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/7936198a-9f3a-4d79-873d-c7b4914bab1c" status: 200 len: 353 microversion: 2.1 time: 0.130692 Jul 07 10:25:50.732555 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 10/12] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jul 7 10:25:50 2022] GET /compute/v2.1/os-volumes/7936198a-9f3a-4d79-873d-c7b4914bab1c => generated 353 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:25:50.750755 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-48dd49cb-3f0e-4ea8-836b-575534ea45cc tempest-VolumesGetTestJSON-52621927 tempest-VolumesGetTestJSON-52621927-project] Calling method '.version_select at 0x7f9ea03c85e0>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:25:50.916061 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-48dd49cb-3f0e-4ea8-836b-575534ea45cc tempest-VolumesGetTestJSON-52621927 tempest-VolumesGetTestJSON-52621927-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/7936198a-9f3a-4d79-873d-c7b4914bab1c" status: 202 len: 0 microversion: 2.1 time: 0.169270 Jul 07 10:25:50.916859 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 3/13] 10.222.0.16 () {58 vars in 1247 bytes} [Thu Jul 7 10:25:50 2022] DELETE /compute/v2.1/os-volumes/7936198a-9f3a-4d79-873d-c7b4914bab1c => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 10:25:50.925881 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-6cd99b8d-c4c1-4105-9b93-64c97fffb4e6 tempest-VolumesGetTestJSON-52621927 tempest-VolumesGetTestJSON-52621927-project] Calling method '.version_select at 0x7f9ea0da9a60>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:25:51.023776 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-6cd99b8d-c4c1-4105-9b93-64c97fffb4e6 tempest-VolumesGetTestJSON-52621927 tempest-VolumesGetTestJSON-52621927-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/7936198a-9f3a-4d79-873d-c7b4914bab1c" status: 200 len: 352 microversion: 2.1 time: 0.101655 Jul 07 10:25:51.024317 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 11/14] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jul 7 10:25:50 2022] GET /compute/v2.1/os-volumes/7936198a-9f3a-4d79-873d-c7b4914bab1c => generated 352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:25:52.037977 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ff1c1a50-e954-4e97-b4b8-fc78afac8245 tempest-VolumesGetTestJSON-52621927 tempest-VolumesGetTestJSON-52621927-project] Calling method '.version_select at 0x7f9ea03c8c10>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:25:52.105483 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-ff1c1a50-e954-4e97-b4b8-fc78afac8245 tempest-VolumesGetTestJSON-52621927 tempest-VolumesGetTestJSON-52621927-project] HTTP exception thrown: Volume 7936198a-9f3a-4d79-873d-c7b4914bab1c could not be found. Jul 07 10:25:52.109820 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ff1c1a50-e954-4e97-b4b8-fc78afac8245 tempest-VolumesGetTestJSON-52621927 tempest-VolumesGetTestJSON-52621927-project] Request method failure captured: Jul 07 10:25:52.109820 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/os-volumes/7936198a-9f3a-4d79-873d-c7b4914bab1c HTTP/1.1 Jul 07 10:25:52.109820 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept: application/json Jul 07 10:25:52.109820 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jul 07 10:25:52.109820 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Connection: close Jul 07 10:25:52.109820 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jul 07 10:25:52.109820 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jul 07 10:25:52.109820 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Host: 10.222.0.16 Jul 07 10:25:52.109820 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jul 07 10:25:52.109820 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jul 07 10:25:52.109820 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABixrSprlLgW_GtGDZvKGvkXG7DSIcDTdreCVY8wUOomRtQGXiosfBJUroOVE9AhFWNMHC7TlK72LnJkb7LCpwt6kvLIpDcZeZU2ohBBTEQ04uKV4o8TzadyAeCiyhwboW7X1QIOtaemswTojFaj0jTH6prTRKYhvQQ8ubNWOfkRp_yFPA Jul 07 10:25:52.109820 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jul 07 10:25:52.109820 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jul 07 10:25:52.109820 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jul 07 10:25:52.109820 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jul 07 10:25:52.109820 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jul 07 10:25:52.109820 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jul 07 10:25:52.109820 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Id: c8f89082d97f4967910ab5dccc941265 Jul 07 10:25:52.109820 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-VolumesGetTestJSON-52621927 Jul 07 10:25:52.109820 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jul 07 10:25:52.109820 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jul 07 10:25:52.110925 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c8f89082d97f4967910ab5dccc941265"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c8f89082d97f4967910ab5dccc941265"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c8f89082d97f4967910ab5dccc941265"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c8f89082d97f4967910ab5dccc941265"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:25:52.110925 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-VolumesGetTestJSON-52621927 Jul 07 10:25:52.110925 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Id: c8f89082d97f4967910ab5dccc941265 Jul 07 10:25:52.110925 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-VolumesGetTestJSON-52621927 Jul 07 10:25:52.110925 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User: tempest-VolumesGetTestJSON-52621927-project Jul 07 10:25:52.110925 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jul 07 10:25:52.110925 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jul 07 10:25:52.110925 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Id: 973c27dbce9a40e59acd7753286f1cb6 Jul 07 10:25:52.110925 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-VolumesGetTestJSON-52621927-project Jul 07 10:25:52.110925 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: method: Jul 07 10:25:52.110925 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: exception: Volume 7936198a-9f3a-4d79-873d-c7b4914bab1c could not be found. Jul 07 10:25:52.110925 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: action_args: {'id': '7936198a-9f3a-4d79-873d-c7b4914bab1c'} Jul 07 10:25:52.110925 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:25:52.111676 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:25:52.111676 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 10:25:52.111676 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 10:25:52.111676 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 10:25:52.111676 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 10:25:52.111676 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 10:25:52.111676 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 10:25:52.111676 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 10:25:52.111676 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 10:25:52.111676 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 10:25:52.111676 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 10:25:52.111676 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 10:25:52.111676 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 10:25:52.111676 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 10:25:52.111676 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 10:25:52.111676 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7936198a-9f3a-4d79-873d-c7b4914bab1c could not be found. (HTTP 404) (Request-ID: req-53a6aa92-14be-49c1-9bf4-bdac6aed4616) Jul 07 10:25:52.111676 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:25:52.111676 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:25:52.111676 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:25:52.112717 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:25:52.112717 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 07 10:25:52.112717 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 07 10:25:52.112717 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 10:25:52.112717 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 10:25:52.112717 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 07 10:25:52.112717 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 07 10:25:52.112717 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 10:25:52.112717 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 10:25:52.112717 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 10:25:52.112717 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 10:25:52.112717 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 10:25:52.112717 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 10:25:52.112717 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 10:25:52.112717 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 10:25:52.112717 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 10:25:52.112717 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 10:25:52.112717 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 10:25:52.112717 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 10:25:52.113774 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 10:25:52.113774 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 10:25:52.113774 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 10:25:52.113774 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 10:25:52.113774 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7936198a-9f3a-4d79-873d-c7b4914bab1c could not be found. Jul 07 10:25:52.113774 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:25:52.113774 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:25:52.113774 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:25:52.113774 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:25:52.113774 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:25:52.113774 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:25:52.113774 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:25:52.113774 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:25:52.113774 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 10:25:52.113774 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 10:25:52.113774 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:25:52.113774 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:25:52.113774 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 07 10:25:52.113774 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:25:52.114784 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7936198a-9f3a-4d79-873d-c7b4914bab1c could not be found. Jul 07 10:25:52.114784 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:25:52.114784 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:25:52.114784 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:25:52.114784 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:25:52.114784 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:25:52.114784 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:25:52.114784 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:25:52.114784 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:25:52.114784 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7936198a-9f3a-4d79-873d-c7b4914bab1c could not be found. Jul 07 10:25:52.114784 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:25:52.117595 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ff1c1a50-e954-4e97-b4b8-fc78afac8245 tempest-VolumesGetTestJSON-52621927 tempest-VolumesGetTestJSON-52621927-project] Returning 404 to user: Volume 7936198a-9f3a-4d79-873d-c7b4914bab1c could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:25:52.118490 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ff1c1a50-e954-4e97-b4b8-fc78afac8245 tempest-VolumesGetTestJSON-52621927 tempest-VolumesGetTestJSON-52621927-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/7936198a-9f3a-4d79-873d-c7b4914bab1c" status: 404 len: 109 microversion: 2.1 time: 0.084301 Jul 07 10:25:52.119353 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 4/15] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jul 7 10:25:52 2022] GET /compute/v2.1/os-volumes/7936198a-9f3a-4d79-873d-c7b4914bab1c => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:25:59.279558 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-8f077829-dc87-47cb-ae70-6e2b8ffd6431 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Action: 'create', calling method: .version_select at 0x7f9ea048bc10>, body: {"keypair": {"name": "tempest-keypair-2054132931", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEw/ckbSTFHBQqrA4urhOhtZvCKlzHGqeOP4TzhvUBmDMW4Q0WC4hRZ2N5rAImbmVrhGUH42DA7zVIBC3i5QOBmKtJ+7HfvP4X4SYJpHz+xUONOZqUYCRMLMS6D1lLIzFw=="}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:25:59.435815 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-8f077829-dc87-47cb-ae70-6e2b8ffd6431 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Getting quotas for project 98924fde961c41358ffb24ac3819557a. Resources: {'key_pairs'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:25:59.454012 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-8f077829-dc87-47cb-ae70-6e2b8ffd6431 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Getting quotas for user 247787cd745444f38953a64780d6ac9b and project 98924fde961c41358ffb24ac3819557a. Resources: {'key_pairs'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:25:59.592559 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-8f077829-dc87-47cb-ae70-6e2b8ffd6431 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.004389 Jul 07 10:25:59.594478 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 12/16] 10.222.0.16 () {60 vars in 1158 bytes} [Thu Jul 7 10:25:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:26:01.828151 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0fb9b54f-ebe3-411b-841d-a80a02e36cef tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1641422010", "imageRef": "1c96509d-f65f-42b0-94b3-6fc590a93508", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:26:02.185477 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.network.neutron [None req-0fb9b54f-ebe3-411b-841d-a80a02e36cef tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] validate_networks() for [('03eb7d11-d380-46df-8615-998b46a27260', None, None, None, None, None)] {{(pid=117647) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 10:26:05.663893 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-0fb9b54f-ebe3-411b-841d-a80a02e36cef tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Flavor limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 10:26:05.664491 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-0fb9b54f-ebe3-411b-841d-a80a02e36cef tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Image limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 10:26:05.665178 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-0fb9b54f-ebe3-411b-841d-a80a02e36cef tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Flavor pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 10:26:05.665972 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-0fb9b54f-ebe3-411b-841d-a80a02e36cef tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Image pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 10:26:05.666570 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-0fb9b54f-ebe3-411b-841d-a80a02e36cef tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 10:26:05.684434 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0fb9b54f-ebe3-411b-841d-a80a02e36cef tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:05.686037 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0fb9b54f-ebe3-411b-841d-a80a02e36cef tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:05.687327 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0fb9b54f-ebe3-411b-841d-a80a02e36cef tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:05.688789 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0fb9b54f-ebe3-411b-841d-a80a02e36cef tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:05.738680 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-0fb9b54f-ebe3-411b-841d-a80a02e36cef tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Getting quotas for project 0a883b49db0f4f32a32bf6d87e2f6104. Resources: {'cores', 'ram', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:26:05.760991 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-0fb9b54f-ebe3-411b-841d-a80a02e36cef tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Getting quotas for user 92b758b22f054dd991e8af99354a134f and project 0a883b49db0f4f32a32bf6d87e2f6104. Resources: {'cores', 'ram', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:26:05.788653 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0fb9b54f-ebe3-411b-841d-a80a02e36cef tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Going to run 1 instances... {{(pid=117647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 10:26:05.798170 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0fb9b54f-ebe3-411b-841d-a80a02e36cef tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c96509d-f65f-42b0-94b3-6fc590a93508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 10:26:05.972374 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0fb9b54f-ebe3-411b-841d-a80a02e36cef tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.939341 Jul 07 10:26:05.979033 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 5/17] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jul 7 10:26:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 4947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 10:26:05.992781 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0e011281-09c8-42af-9491-8d06dea9a5e9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-119497427", "imageRef": "1c96509d-f65f-42b0-94b3-6fc590a93508", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b08fa55b-4190-4e6d-8467-4b3e6107ca87"}], "security_groups": [{"name": "tempest-securitygroup--1507409813"}], "key_name": "tempest-keypair-2054132931", "user_data": "}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:26:06.376182 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.network.neutron [None req-0e011281-09c8-42af-9491-8d06dea9a5e9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] validate_networks() for [('b08fa55b-4190-4e6d-8467-4b3e6107ca87', None, None, None, None, None)] {{(pid=117647) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 10:26:06.411895 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-828534fe-4676-4938-9b97-04131a524aa7 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1561892088", "imageRef": "1c96509d-f65f-42b0-94b3-6fc590a93508", "flavorRef": "452", "networks": [{"uuid": "0130b19f-e9e8-4fb0-9387-7681bab626e8"}]}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:26:06.605144 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.network.neutron [None req-828534fe-4676-4938-9b97-04131a524aa7 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] validate_networks() for [('0130b19f-e9e8-4fb0-9387-7681bab626e8', None, None, None, None, None)] {{(pid=117646) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 10:26:07.657000 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-0e011281-09c8-42af-9491-8d06dea9a5e9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Flavor limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 10:26:07.658136 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-0e011281-09c8-42af-9491-8d06dea9a5e9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Image limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 10:26:07.658779 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-0e011281-09c8-42af-9491-8d06dea9a5e9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Flavor pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 10:26:07.659328 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-0e011281-09c8-42af-9491-8d06dea9a5e9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Image pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 10:26:07.664734 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-0e011281-09c8-42af-9491-8d06dea9a5e9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 10:26:07.684288 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0e011281-09c8-42af-9491-8d06dea9a5e9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:07.684742 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0e011281-09c8-42af-9491-8d06dea9a5e9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:07.685537 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0e011281-09c8-42af-9491-8d06dea9a5e9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:07.688055 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0e011281-09c8-42af-9491-8d06dea9a5e9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:07.726669 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-0e011281-09c8-42af-9491-8d06dea9a5e9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Getting quotas for project 98924fde961c41358ffb24ac3819557a. Resources: {'cores', 'ram', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:26:07.738298 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-0e011281-09c8-42af-9491-8d06dea9a5e9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Getting quotas for user 247787cd745444f38953a64780d6ac9b and project 98924fde961c41358ffb24ac3819557a. Resources: {'cores', 'ram', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:26:07.762644 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0e011281-09c8-42af-9491-8d06dea9a5e9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Going to run 1 instances... {{(pid=117647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 10:26:07.765331 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0e011281-09c8-42af-9491-8d06dea9a5e9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c96509d-f65f-42b0-94b3-6fc590a93508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 10:26:07.930942 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0e011281-09c8-42af-9491-8d06dea9a5e9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.950361 Jul 07 10:26:07.932048 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 6/18] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jul 7 10:26:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 1952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 10:26:07.943521 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8fae0e9b-c3b5-46cd-8ddd-5dad5be4b6a4 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:07.944861 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8fae0e9b-c3b5-46cd-8ddd-5dad5be4b6a4 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:08.048242 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8fae0e9b-c3b5-46cd-8ddd-5dad5be4b6a4 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:08.068247 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8fae0e9b-c3b5-46cd-8ddd-5dad5be4b6a4 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f" status: 200 len: 1222 microversion: 2.1 time: 0.128802 Jul 07 10:26:08.069169 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 7/19] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:07 2022] GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f => generated 1222 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:08.090579 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-7dfdab6d-90e0-4c07-9acc-d7d1a40f6367 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:08.097379 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-7dfdab6d-90e0-4c07-9acc-d7d1a40f6367 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:08.243553 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-7dfdab6d-90e0-4c07-9acc-d7d1a40f6367 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:08.253170 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-7dfdab6d-90e0-4c07-9acc-d7d1a40f6367 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1237 microversion: 2.1 time: 0.179005 Jul 07 10:26:08.254090 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 8/20] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:08 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1237 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:08.569726 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d9e2dd79-3206-4960-bc7d-5b0ad6d060db tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1678506512", "imageRef": "1c96509d-f65f-42b0-94b3-6fc590a93508", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:26:08.656162 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.network.neutron [None req-d9e2dd79-3206-4960-bc7d-5b0ad6d060db tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] validate_networks() for [('03eb7d11-d380-46df-8615-998b46a27260', None, None, None, None, None)] {{(pid=117647) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 10:26:09.300841 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-d9e2dd79-3206-4960-bc7d-5b0ad6d060db tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Flavor limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 10:26:09.302155 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-d9e2dd79-3206-4960-bc7d-5b0ad6d060db tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Image limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 10:26:09.302635 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-d9e2dd79-3206-4960-bc7d-5b0ad6d060db tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Flavor pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 10:26:09.303607 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-d9e2dd79-3206-4960-bc7d-5b0ad6d060db tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Image pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 10:26:09.304107 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-d9e2dd79-3206-4960-bc7d-5b0ad6d060db tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 10:26:09.319375 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d9e2dd79-3206-4960-bc7d-5b0ad6d060db tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:09.320189 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d9e2dd79-3206-4960-bc7d-5b0ad6d060db tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:09.321024 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d9e2dd79-3206-4960-bc7d-5b0ad6d060db tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:09.321467 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d9e2dd79-3206-4960-bc7d-5b0ad6d060db tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:09.354208 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-828534fe-4676-4938-9b97-04131a524aa7 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Flavor limits 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 10:26:09.355527 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-828534fe-4676-4938-9b97-04131a524aa7 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Image limits 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 10:26:09.356350 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-828534fe-4676-4938-9b97-04131a524aa7 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Flavor pref 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 10:26:09.357065 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-828534fe-4676-4938-9b97-04131a524aa7 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Image pref 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 10:26:09.357773 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-828534fe-4676-4938-9b97-04131a524aa7 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 10:26:09.363291 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-d9e2dd79-3206-4960-bc7d-5b0ad6d060db tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Getting quotas for project 0a883b49db0f4f32a32bf6d87e2f6104. Resources: {'cores', 'ram', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:26:09.376632 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-d9e2dd79-3206-4960-bc7d-5b0ad6d060db tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Getting quotas for user 92b758b22f054dd991e8af99354a134f and project 0a883b49db0f4f32a32bf6d87e2f6104. Resources: {'cores', 'ram', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:26:09.381066 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-828534fe-4676-4938-9b97-04131a524aa7 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:09.385392 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-828534fe-4676-4938-9b97-04131a524aa7 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:09.386249 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-828534fe-4676-4938-9b97-04131a524aa7 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:09.389385 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-828534fe-4676-4938-9b97-04131a524aa7 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:09.392060 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d9e2dd79-3206-4960-bc7d-5b0ad6d060db tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Going to run 1 instances... {{(pid=117647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 10:26:09.394199 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d9e2dd79-3206-4960-bc7d-5b0ad6d060db tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c96509d-f65f-42b0-94b3-6fc590a93508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 10:26:09.450218 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d9e2dd79-3206-4960-bc7d-5b0ad6d060db tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.885391 Jul 07 10:26:09.451770 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 9/21] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jul 7 10:26:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 07 10:26:09.457109 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-3f62748a-18cd-4b6e-844d-b2a161646204 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:09.458109 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-3f62748a-18cd-4b6e-844d-b2a161646204 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:09.465387 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3f62748a-18cd-4b6e-844d-b2a161646204 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:09.466207 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3f62748a-18cd-4b6e-844d-b2a161646204 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:09.467322 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3f62748a-18cd-4b6e-844d-b2a161646204 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:09.468033 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3f62748a-18cd-4b6e-844d-b2a161646204 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:09.478687 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-828534fe-4676-4938-9b97-04131a524aa7 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Getting quotas for project 0c765bc215964bce8a321b4f3d085ae6. Resources: {'cores', 'ram', 'instances'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:26:09.526216 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-828534fe-4676-4938-9b97-04131a524aa7 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Getting quotas for user 730e7d9b92c84bd5872bc0e221b616cf and project 0c765bc215964bce8a321b4f3d085ae6. Resources: {'cores', 'ram', 'instances'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:26:09.570744 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-828534fe-4676-4938-9b97-04131a524aa7 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Going to run 1 instances... {{(pid=117646) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 10:26:09.577030 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-828534fe-4676-4938-9b97-04131a524aa7 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c96509d-f65f-42b0-94b3-6fc590a93508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 10:26:09.694457 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-3f62748a-18cd-4b6e-844d-b2a161646204 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:09.718412 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-3f62748a-18cd-4b6e-844d-b2a161646204 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1289 microversion: 2.1 time: 0.265177 Jul 07 10:26:09.718938 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 10/22] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:09 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1289 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:09.735433 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-65d3da1a-1070-4a7b-8450-3af65f1b821b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:09.736220 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-65d3da1a-1070-4a7b-8450-3af65f1b821b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:09.744238 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-828534fe-4676-4938-9b97-04131a524aa7 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.335748 Jul 07 10:26:09.744883 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 13/23] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jul 7 10:26:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 4337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 10:26:09.760477 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-87bb15e5-2518-481d-9f5b-84313bb0ba86 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:09.761097 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-87bb15e5-2518-481d-9f5b-84313bb0ba86 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:09.880356 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-65d3da1a-1070-4a7b-8450-3af65f1b821b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:09.892984 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-65d3da1a-1070-4a7b-8450-3af65f1b821b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1222 microversion: 2.1 time: 0.166342 Jul 07 10:26:09.895536 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 11/24] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:09 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1222 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:09.913285 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-87bb15e5-2518-481d-9f5b-84313bb0ba86 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730e7d9b92c84bd5872bc0e221b616cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c765bc215964bce8a321b4f3d085ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:09.930545 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-87bb15e5-2518-481d-9f5b-84313bb0ba86 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 200 len: 1215 microversion: 2.1 time: 0.174259 Jul 07 10:26:09.931414 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 14/25] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:09 2022] GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 1215 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:10.736440 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-521af493-5926-46af-a731-bd7c004f9de4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:10.737329 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-521af493-5926-46af-a731-bd7c004f9de4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:10.750254 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-521af493-5926-46af-a731-bd7c004f9de4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:10.752139 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-521af493-5926-46af-a731-bd7c004f9de4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:10.758452 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-521af493-5926-46af-a731-bd7c004f9de4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:10.762580 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-521af493-5926-46af-a731-bd7c004f9de4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:10.911420 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-efb2a0d3-74c4-4add-92cd-13e5c4b715af tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:10.912202 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-efb2a0d3-74c4-4add-92cd-13e5c4b715af tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:10.941432 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-efb2a0d3-74c4-4add-92cd-13e5c4b715af tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:10.945817 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-efb2a0d3-74c4-4add-92cd-13e5c4b715af tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:10.949970 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-efb2a0d3-74c4-4add-92cd-13e5c4b715af tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:10.951400 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-efb2a0d3-74c4-4add-92cd-13e5c4b715af tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:11.098356 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-521af493-5926-46af-a731-bd7c004f9de4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:11.107703 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-521af493-5926-46af-a731-bd7c004f9de4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1295 microversion: 2.1 time: 0.376001 Jul 07 10:26:11.112946 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 12/26] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:10 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1295 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:11.117899 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8e7a607d-1f03-440a-a472-64a2cd60b3bd tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:11.118542 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8e7a607d-1f03-440a-a472-64a2cd60b3bd tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:11.137308 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8e7a607d-1f03-440a-a472-64a2cd60b3bd tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:11.138036 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8e7a607d-1f03-440a-a472-64a2cd60b3bd tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:11.139075 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8e7a607d-1f03-440a-a472-64a2cd60b3bd tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:11.142267 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8e7a607d-1f03-440a-a472-64a2cd60b3bd tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:11.324338 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8e7a607d-1f03-440a-a472-64a2cd60b3bd tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730e7d9b92c84bd5872bc0e221b616cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c765bc215964bce8a321b4f3d085ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:11.336291 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-efb2a0d3-74c4-4add-92cd-13e5c4b715af tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:11.349530 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8e7a607d-1f03-440a-a472-64a2cd60b3bd tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 200 len: 1267 microversion: 2.1 time: 0.235184 Jul 07 10:26:11.355596 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 13/27] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:11 2022] GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 1267 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:11.364844 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-efb2a0d3-74c4-4add-92cd-13e5c4b715af tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1274 microversion: 2.1 time: 0.456348 Jul 07 10:26:11.366777 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 15/28] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:10 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1274 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:12.126462 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-94781e05-3f39-40bc-acba-296b63dcc592 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:12.127072 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-94781e05-3f39-40bc-acba-296b63dcc592 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:12.135764 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-94781e05-3f39-40bc-acba-296b63dcc592 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:12.136237 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-94781e05-3f39-40bc-acba-296b63dcc592 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:12.137584 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-94781e05-3f39-40bc-acba-296b63dcc592 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:12.149179 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-94781e05-3f39-40bc-acba-296b63dcc592 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:12.367554 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-be67662a-7fda-4f85-9e1b-ebf5067e79c5 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:12.368228 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-be67662a-7fda-4f85-9e1b-ebf5067e79c5 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:12.389245 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-be67662a-7fda-4f85-9e1b-ebf5067e79c5 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:12.393848 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-be67662a-7fda-4f85-9e1b-ebf5067e79c5 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:12.399196 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-be67662a-7fda-4f85-9e1b-ebf5067e79c5 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:12.404104 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-be67662a-7fda-4f85-9e1b-ebf5067e79c5 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:12.674014 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-be67662a-7fda-4f85-9e1b-ebf5067e79c5 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730e7d9b92c84bd5872bc0e221b616cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c765bc215964bce8a321b4f3d085ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:12.687590 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-be67662a-7fda-4f85-9e1b-ebf5067e79c5 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 200 len: 1273 microversion: 2.1 time: 0.319859 Jul 07 10:26:12.701838 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 16/29] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:12 2022] GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 1273 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:26:12.718744 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-4defa982-183f-4f2a-8d94-a45afb8720cf tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:12.719398 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-4defa982-183f-4f2a-8d94-a45afb8720cf tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:12.738108 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4defa982-183f-4f2a-8d94-a45afb8720cf tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:12.738567 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4defa982-183f-4f2a-8d94-a45afb8720cf tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:12.748768 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4defa982-183f-4f2a-8d94-a45afb8720cf tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:12.751400 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4defa982-183f-4f2a-8d94-a45afb8720cf tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:12.888572 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-4defa982-183f-4f2a-8d94-a45afb8720cf tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:12.901069 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-4defa982-183f-4f2a-8d94-a45afb8720cf tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1280 microversion: 2.1 time: 0.196980 Jul 07 10:26:12.905797 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 17/30] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:12 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1280 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:13.708742 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-36ea8940-da04-48cf-bff8-f9dcf9123135 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:13.709492 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-36ea8940-da04-48cf-bff8-f9dcf9123135 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:13.731427 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-36ea8940-da04-48cf-bff8-f9dcf9123135 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:13.758367 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-36ea8940-da04-48cf-bff8-f9dcf9123135 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:13.760796 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-36ea8940-da04-48cf-bff8-f9dcf9123135 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:13.761781 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-36ea8940-da04-48cf-bff8-f9dcf9123135 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:14.551961 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-94781e05-3f39-40bc-acba-296b63dcc592 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:14.568091 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-94781e05-3f39-40bc-acba-296b63dcc592 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1363 microversion: 2.1 time: 2.443072 Jul 07 10:26:14.571387 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 14/31] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:12 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1363 bytes in 2449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:14.580775 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5e82c76e-2275-44a2-87aa-67f829839c59 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:14.586275 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5e82c76e-2275-44a2-87aa-67f829839c59 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:14.618912 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5e82c76e-2275-44a2-87aa-67f829839c59 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:14.623514 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5e82c76e-2275-44a2-87aa-67f829839c59 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:14.624814 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5e82c76e-2275-44a2-87aa-67f829839c59 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:14.626903 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5e82c76e-2275-44a2-87aa-67f829839c59 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:14.859140 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5e82c76e-2275-44a2-87aa-67f829839c59 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:14.874616 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5e82c76e-2275-44a2-87aa-67f829839c59 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1280 microversion: 2.1 time: 0.298702 Jul 07 10:26:14.876274 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 15/32] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:14 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1280 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:15.145533 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-36ea8940-da04-48cf-bff8-f9dcf9123135 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730e7d9b92c84bd5872bc0e221b616cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c765bc215964bce8a321b4f3d085ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:15.154364 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-36ea8940-da04-48cf-bff8-f9dcf9123135 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 200 len: 1315 microversion: 2.1 time: 1.450726 Jul 07 10:26:15.156868 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 18/33] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:13 2022] GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 1315 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:15.593473 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-fc1c0fea-fe48-46a6-98e9-6858cbb8d470 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:15.596266 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-fc1c0fea-fe48-46a6-98e9-6858cbb8d470 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:15.616345 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fc1c0fea-fe48-46a6-98e9-6858cbb8d470 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:15.617403 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fc1c0fea-fe48-46a6-98e9-6858cbb8d470 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:15.619723 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fc1c0fea-fe48-46a6-98e9-6858cbb8d470 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:15.621043 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fc1c0fea-fe48-46a6-98e9-6858cbb8d470 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:15.900065 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-de581fdc-055d-4289-873a-34c9a6b8f0ec tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:15.900684 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-de581fdc-055d-4289-873a-34c9a6b8f0ec tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:15.919090 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-de581fdc-055d-4289-873a-34c9a6b8f0ec tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:15.921830 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-de581fdc-055d-4289-873a-34c9a6b8f0ec tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:15.923611 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-de581fdc-055d-4289-873a-34c9a6b8f0ec tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:15.927455 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-de581fdc-055d-4289-873a-34c9a6b8f0ec tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:16.848265 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-de581fdc-055d-4289-873a-34c9a6b8f0ec tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:16.862941 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-de581fdc-055d-4289-873a-34c9a6b8f0ec tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1322 microversion: 2.1 time: 0.965151 Jul 07 10:26:16.865886 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 19/34] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:15 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1322 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:26:16.892910 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-ffde3c61-ea84-487d-ab5e-c5d2109f3490 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:16.895957 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-ffde3c61-ea84-487d-ab5e-c5d2109f3490 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:16.922590 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ffde3c61-ea84-487d-ab5e-c5d2109f3490 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:16.926106 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ffde3c61-ea84-487d-ab5e-c5d2109f3490 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:16.927738 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ffde3c61-ea84-487d-ab5e-c5d2109f3490 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:16.928715 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ffde3c61-ea84-487d-ab5e-c5d2109f3490 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:17.176792 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-fc1c0fea-fe48-46a6-98e9-6858cbb8d470 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:17.197822 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-fc1c0fea-fe48-46a6-98e9-6858cbb8d470 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1363 microversion: 2.1 time: 1.610329 Jul 07 10:26:17.198940 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 16/35] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:15 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1363 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:17.599186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-3ac7493a-7658-4aee-acb0-836784b78e52 req-7383ad8d-050c-49a1-93fc-3cc9d7bdcacb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11", "tag": "4af65680-4c8a-4420-938b-02b9403f177e"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:26:17.625219 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-3ac7493a-7658-4aee-acb0-836784b78e52 req-7383ad8d-050c-49a1-93fc-3cc9d7bdcacb service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:17.625727 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-3ac7493a-7658-4aee-acb0-836784b78e52 req-7383ad8d-050c-49a1-93fc-3cc9d7bdcacb service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:17.685728 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-3ac7493a-7658-4aee-acb0-836784b78e52 req-7383ad8d-050c-49a1-93fc-3cc9d7bdcacb service nova] Creating event network-changed:4af65680-4c8a-4420-938b-02b9403f177e for instance 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 on hv-cinder-82282 Jul 07 10:26:17.686913 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-3ac7493a-7658-4aee-acb0-836784b78e52 req-7383ad8d-050c-49a1-93fc-3cc9d7bdcacb service nova] Acquired lock "compute-rpcapi-router" {{(pid=117647) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 07 10:26:17.689174 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-96a403cb-c036-43b8-a313-d38685373264 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:17.689954 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-96a403cb-c036-43b8-a313-d38685373264 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:17.691260 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-96a403cb-c036-43b8-a313-d38685373264 None None] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:17.694404 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-96a403cb-c036-43b8-a313-d38685373264 None None] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:17.725267 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.compute.rpcapi [None req-96a403cb-c036-43b8-a313-d38685373264 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 07 10:26:17.727486 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-96a403cb-c036-43b8-a313-d38685373264 None None] Releasing lock "compute-rpcapi-router" {{(pid=117647) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 07 10:26:17.781378 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-96a403cb-c036-43b8-a313-d38685373264 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.580951 Jul 07 10:26:17.783897 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 17/36] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:26:17.833900 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-ffde3c61-ea84-487d-ab5e-c5d2109f3490 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730e7d9b92c84bd5872bc0e221b616cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c765bc215964bce8a321b4f3d085ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:17.842093 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-ffde3c61-ea84-487d-ab5e-c5d2109f3490 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 200 len: 1315 microversion: 2.1 time: 0.974255 Jul 07 10:26:17.847517 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 20/37] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:16 2022] GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 1315 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:17.884356 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-315d7b63-d39a-43db-9c3e-c9e3142bf0d3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:17.885194 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-315d7b63-d39a-43db-9c3e-c9e3142bf0d3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:17.902318 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-315d7b63-d39a-43db-9c3e-c9e3142bf0d3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:17.903213 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-315d7b63-d39a-43db-9c3e-c9e3142bf0d3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:17.904348 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-315d7b63-d39a-43db-9c3e-c9e3142bf0d3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:17.907143 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-315d7b63-d39a-43db-9c3e-c9e3142bf0d3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:18.216574 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-6e3c4df8-54e7-4cee-8567-9984ab48bb11 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:18.217175 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-6e3c4df8-54e7-4cee-8567-9984ab48bb11 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:18.232051 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6e3c4df8-54e7-4cee-8567-9984ab48bb11 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:18.234504 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6e3c4df8-54e7-4cee-8567-9984ab48bb11 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:18.237155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6e3c4df8-54e7-4cee-8567-9984ab48bb11 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:18.237715 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6e3c4df8-54e7-4cee-8567-9984ab48bb11 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:18.725903 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-6e3c4df8-54e7-4cee-8567-9984ab48bb11 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:18.749839 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-6e3c4df8-54e7-4cee-8567-9984ab48bb11 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1363 microversion: 2.1 time: 0.533150 Jul 07 10:26:18.752737 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 21/38] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:18 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1363 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:26:18.865125 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-db07fd09-634d-42c5-9b77-5dc3d28eb6f4 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:18.866274 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-db07fd09-634d-42c5-9b77-5dc3d28eb6f4 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:18.884128 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-db07fd09-634d-42c5-9b77-5dc3d28eb6f4 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:18.886713 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-db07fd09-634d-42c5-9b77-5dc3d28eb6f4 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:18.891783 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-db07fd09-634d-42c5-9b77-5dc3d28eb6f4 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:18.892912 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-db07fd09-634d-42c5-9b77-5dc3d28eb6f4 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:19.005427 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-315d7b63-d39a-43db-9c3e-c9e3142bf0d3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:19.021522 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-315d7b63-d39a-43db-9c3e-c9e3142bf0d3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1322 microversion: 2.1 time: 1.140136 Jul 07 10:26:19.027827 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 18/39] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:17 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1322 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:19.438325 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell0:SELECT=2 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:26:19.631772 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-db07fd09-634d-42c5-9b77-5dc3d28eb6f4 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730e7d9b92c84bd5872bc0e221b616cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c765bc215964bce8a321b4f3d085ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:19.645918 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-db07fd09-634d-42c5-9b77-5dc3d28eb6f4 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 200 len: 1315 microversion: 2.1 time: 0.784653 Jul 07 10:26:19.646516 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 22/40] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:18 2022] GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 1315 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:19.777372 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-eec9f3ff-eb1f-4829-a76c-e1bcd113e83e tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:19.779314 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-eec9f3ff-eb1f-4829-a76c-e1bcd113e83e tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:19.797818 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-eec9f3ff-eb1f-4829-a76c-e1bcd113e83e tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:19.798517 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-eec9f3ff-eb1f-4829-a76c-e1bcd113e83e tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:19.800237 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-eec9f3ff-eb1f-4829-a76c-e1bcd113e83e tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:19.801679 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-eec9f3ff-eb1f-4829-a76c-e1bcd113e83e tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:19.885198 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=24 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:26:20.041531 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-6b302200-2395-4414-88cc-4c354dfa2151 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:20.042234 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-6b302200-2395-4414-88cc-4c354dfa2151 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:20.049775 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell0:SELECT=12 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:26:20.055017 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6b302200-2395-4414-88cc-4c354dfa2151 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:20.055480 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6b302200-2395-4414-88cc-4c354dfa2151 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:20.056559 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6b302200-2395-4414-88cc-4c354dfa2151 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:20.057175 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6b302200-2395-4414-88cc-4c354dfa2151 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:20.290716 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-6b302200-2395-4414-88cc-4c354dfa2151 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:20.307950 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-6b302200-2395-4414-88cc-4c354dfa2151 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1322 microversion: 2.1 time: 0.266773 Jul 07 10:26:20.310285 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 23/41] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:20 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:26:20.577453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-eec9f3ff-eb1f-4829-a76c-e1bcd113e83e tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:20.595125 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-eec9f3ff-eb1f-4829-a76c-e1bcd113e83e tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1363 microversion: 2.1 time: 0.828303 Jul 07 10:26:20.601383 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 19/42] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:19 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1363 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:20.612644 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-5f25938d-767e-4f51-af39-4942c5f81d33 req-752fc39b-331d-4a72-9646-aa992ddb73a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a1d0d51-844a-4a45-9f11-71081578d56f", "tag": "78fdfce4-3284-497c-b70f-045463371669"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:26:20.643869 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-5f25938d-767e-4f51-af39-4942c5f81d33 req-752fc39b-331d-4a72-9646-aa992ddb73a4 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:20.645558 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-5f25938d-767e-4f51-af39-4942c5f81d33 req-752fc39b-331d-4a72-9646-aa992ddb73a4 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:20.663977 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-43f5d166-4db1-4b80-b8d4-267e4d157c25 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:20.665021 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-43f5d166-4db1-4b80-b8d4-267e4d157c25 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:20.697031 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-43f5d166-4db1-4b80-b8d4-267e4d157c25 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:20.701020 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-43f5d166-4db1-4b80-b8d4-267e4d157c25 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:20.707578 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-5f25938d-767e-4f51-af39-4942c5f81d33 req-752fc39b-331d-4a72-9646-aa992ddb73a4 service nova] Creating event network-changed:78fdfce4-3284-497c-b70f-045463371669 for instance 1a1d0d51-844a-4a45-9f11-71081578d56f on hv-cinder-82282 Jul 07 10:26:20.708421 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-5f25938d-767e-4f51-af39-4942c5f81d33 req-752fc39b-331d-4a72-9646-aa992ddb73a4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117646) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 07 10:26:20.710320 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f94ecf3e-b85c-42a6-84a0-736a7c945eb6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:20.710439 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-43f5d166-4db1-4b80-b8d4-267e4d157c25 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:20.711105 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f94ecf3e-b85c-42a6-84a0-736a7c945eb6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:20.711828 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-43f5d166-4db1-4b80-b8d4-267e4d157c25 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:20.713127 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f94ecf3e-b85c-42a6-84a0-736a7c945eb6 None None] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:20.713778 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f94ecf3e-b85c-42a6-84a0-736a7c945eb6 None None] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:20.735406 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.compute.rpcapi [None req-f94ecf3e-b85c-42a6-84a0-736a7c945eb6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 07 10:26:20.737208 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f94ecf3e-b85c-42a6-84a0-736a7c945eb6 None None] Releasing lock "compute-rpcapi-router" {{(pid=117646) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 07 10:26:20.784800 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-f94ecf3e-b85c-42a6-84a0-736a7c945eb6 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.465569 Jul 07 10:26:20.785782 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 24/43] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:26:21.077558 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-43f5d166-4db1-4b80-b8d4-267e4d157c25 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730e7d9b92c84bd5872bc0e221b616cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c765bc215964bce8a321b4f3d085ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:21.094215 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-43f5d166-4db1-4b80-b8d4-267e4d157c25 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 200 len: 1315 microversion: 2.1 time: 0.435401 Jul 07 10:26:21.094801 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 20/44] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:20 2022] GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:26:21.329193 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-1be0f0ce-8e38-4d08-bd0e-4293d8514f93 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:21.330215 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-1be0f0ce-8e38-4d08-bd0e-4293d8514f93 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:21.345365 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1be0f0ce-8e38-4d08-bd0e-4293d8514f93 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:21.346470 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1be0f0ce-8e38-4d08-bd0e-4293d8514f93 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:21.347338 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1be0f0ce-8e38-4d08-bd0e-4293d8514f93 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:21.352311 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1be0f0ce-8e38-4d08-bd0e-4293d8514f93 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:21.531359 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-1be0f0ce-8e38-4d08-bd0e-4293d8514f93 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:21.539598 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-1be0f0ce-8e38-4d08-bd0e-4293d8514f93 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1322 microversion: 2.1 time: 0.216396 Jul 07 10:26:21.540205 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 25/45] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:21 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:21.613458 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-26736fb8-2146-40bf-822a-14d2567e97b8 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:21.614068 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-26736fb8-2146-40bf-822a-14d2567e97b8 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:21.620783 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-26736fb8-2146-40bf-822a-14d2567e97b8 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:21.621423 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-26736fb8-2146-40bf-822a-14d2567e97b8 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:21.622379 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-26736fb8-2146-40bf-822a-14d2567e97b8 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:21.622884 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-26736fb8-2146-40bf-822a-14d2567e97b8 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:21.772235 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-26736fb8-2146-40bf-822a-14d2567e97b8 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:21.784010 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-26736fb8-2146-40bf-822a-14d2567e97b8 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1363 microversion: 2.1 time: 0.171575 Jul 07 10:26:21.784760 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 21/46] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:21 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:22.111354 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-9cdde5b5-8f46-4d6a-9174-ed8de234da56 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:22.112121 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-9cdde5b5-8f46-4d6a-9174-ed8de234da56 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:22.118449 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9cdde5b5-8f46-4d6a-9174-ed8de234da56 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:22.119129 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9cdde5b5-8f46-4d6a-9174-ed8de234da56 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:22.119956 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9cdde5b5-8f46-4d6a-9174-ed8de234da56 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:22.121191 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9cdde5b5-8f46-4d6a-9174-ed8de234da56 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:22.313223 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-9cdde5b5-8f46-4d6a-9174-ed8de234da56 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730e7d9b92c84bd5872bc0e221b616cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c765bc215964bce8a321b4f3d085ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:22.322333 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-9cdde5b5-8f46-4d6a-9174-ed8de234da56 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 200 len: 1315 microversion: 2.1 time: 0.214346 Jul 07 10:26:22.325467 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 26/47] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:22 2022] GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:22.556921 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-7f37a86c-cd5a-4245-b003-e44e8d90ee4e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:22.557981 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-7f37a86c-cd5a-4245-b003-e44e8d90ee4e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:22.565715 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7f37a86c-cd5a-4245-b003-e44e8d90ee4e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:22.566528 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7f37a86c-cd5a-4245-b003-e44e8d90ee4e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:22.567551 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7f37a86c-cd5a-4245-b003-e44e8d90ee4e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:22.568248 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7f37a86c-cd5a-4245-b003-e44e8d90ee4e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:22.779646 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-7f37a86c-cd5a-4245-b003-e44e8d90ee4e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:22.790545 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-7f37a86c-cd5a-4245-b003-e44e8d90ee4e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1322 microversion: 2.1 time: 0.237471 Jul 07 10:26:22.791328 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 22/48] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:22 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:22.801491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-e1ac27f3-bfaf-468c-91be-fd6b3ac53926 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:22.802211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-e1ac27f3-bfaf-468c-91be-fd6b3ac53926 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:22.810993 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e1ac27f3-bfaf-468c-91be-fd6b3ac53926 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:22.812196 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e1ac27f3-bfaf-468c-91be-fd6b3ac53926 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:22.816207 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e1ac27f3-bfaf-468c-91be-fd6b3ac53926 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:22.816677 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e1ac27f3-bfaf-468c-91be-fd6b3ac53926 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:22.829935 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-a046d0b4-7e13-4b1a-8266-541407b00605 req-7efd21e0-6658-4020-ae24-1eb576c25244 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b00a3c72-669b-41e2-a9b9-1a2921bcabe0", "tag": "ab69b298-c3d4-4702-89eb-78fe3392b9f5"}, {"name": "network-changed", "server_uuid": "08e45c86-fe48-454c-8b7e-3e03765d79c1", "tag": "3f5c850a-9465-4487-9bb2-f2d849e2ab3d"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:26:22.844921 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-a046d0b4-7e13-4b1a-8266-541407b00605 req-7efd21e0-6658-4020-ae24-1eb576c25244 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:22.845385 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-a046d0b4-7e13-4b1a-8266-541407b00605 req-7efd21e0-6658-4020-ae24-1eb576c25244 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:22.863981 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-a046d0b4-7e13-4b1a-8266-541407b00605 req-7efd21e0-6658-4020-ae24-1eb576c25244 service nova] Creating event network-changed:ab69b298-c3d4-4702-89eb-78fe3392b9f5 for instance b00a3c72-669b-41e2-a9b9-1a2921bcabe0 on hv-cinder-82282 Jul 07 10:26:22.864748 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-a046d0b4-7e13-4b1a-8266-541407b00605 req-7efd21e0-6658-4020-ae24-1eb576c25244 service nova] Creating event network-changed:3f5c850a-9465-4487-9bb2-f2d849e2ab3d for instance 08e45c86-fe48-454c-8b7e-3e03765d79c1 on hv-cinder-82282 Jul 07 10:26:22.871970 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-a046d0b4-7e13-4b1a-8266-541407b00605 req-7efd21e0-6658-4020-ae24-1eb576c25244 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.045659 Jul 07 10:26:22.873079 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 23/49] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:26:23.065617 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-e1ac27f3-bfaf-468c-91be-fd6b3ac53926 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:23.076044 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-e1ac27f3-bfaf-468c-91be-fd6b3ac53926 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1363 microversion: 2.1 time: 0.277693 Jul 07 10:26:23.077257 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 27/50] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:22 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1363 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:23.342129 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-13beba23-10b2-499f-b82e-e5a6024d2dd3 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:23.343096 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-13beba23-10b2-499f-b82e-e5a6024d2dd3 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:23.351963 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-13beba23-10b2-499f-b82e-e5a6024d2dd3 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:23.352436 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-13beba23-10b2-499f-b82e-e5a6024d2dd3 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:23.353219 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-13beba23-10b2-499f-b82e-e5a6024d2dd3 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:23.353662 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-13beba23-10b2-499f-b82e-e5a6024d2dd3 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:23.689395 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-13beba23-10b2-499f-b82e-e5a6024d2dd3 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730e7d9b92c84bd5872bc0e221b616cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c765bc215964bce8a321b4f3d085ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:23.701619 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-13beba23-10b2-499f-b82e-e5a6024d2dd3 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 200 len: 1315 microversion: 2.1 time: 0.363582 Jul 07 10:26:23.704762 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 24/51] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:23 2022] GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:23.812777 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-97081f0a-233b-4eb1-88d9-914b30a3a4f8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:23.814617 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-97081f0a-233b-4eb1-88d9-914b30a3a4f8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:23.822191 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-97081f0a-233b-4eb1-88d9-914b30a3a4f8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:23.822935 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-97081f0a-233b-4eb1-88d9-914b30a3a4f8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:23.824005 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-97081f0a-233b-4eb1-88d9-914b30a3a4f8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:23.825055 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-97081f0a-233b-4eb1-88d9-914b30a3a4f8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:24.095265 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2a94776d-96ac-40b3-bd6a-fd73f63a1227 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:24.096004 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-2a94776d-96ac-40b3-bd6a-fd73f63a1227 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:24.108305 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2a94776d-96ac-40b3-bd6a-fd73f63a1227 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:24.108766 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2a94776d-96ac-40b3-bd6a-fd73f63a1227 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:24.109554 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2a94776d-96ac-40b3-bd6a-fd73f63a1227 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:24.109993 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2a94776d-96ac-40b3-bd6a-fd73f63a1227 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:24.176066 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-97081f0a-233b-4eb1-88d9-914b30a3a4f8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:24.190095 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-97081f0a-233b-4eb1-88d9-914b30a3a4f8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1322 microversion: 2.1 time: 0.383389 Jul 07 10:26:24.195799 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 28/52] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:23 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1322 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:24.501631 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-2a94776d-96ac-40b3-bd6a-fd73f63a1227 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:24.515215 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-2a94776d-96ac-40b3-bd6a-fd73f63a1227 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1363 microversion: 2.1 time: 0.425966 Jul 07 10:26:24.524407 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 25/53] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:24 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1363 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:24.726307 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-7008e656-9689-46a2-bfb7-7319571c0cf4 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:24.729544 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-7008e656-9689-46a2-bfb7-7319571c0cf4 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:24.753567 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7008e656-9689-46a2-bfb7-7319571c0cf4 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:24.757410 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7008e656-9689-46a2-bfb7-7319571c0cf4 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:24.758229 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7008e656-9689-46a2-bfb7-7319571c0cf4 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:24.759007 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7008e656-9689-46a2-bfb7-7319571c0cf4 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:24.978970 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-7008e656-9689-46a2-bfb7-7319571c0cf4 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730e7d9b92c84bd5872bc0e221b616cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c765bc215964bce8a321b4f3d085ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:24.987379 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-7008e656-9689-46a2-bfb7-7319571c0cf4 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 200 len: 1315 microversion: 2.1 time: 0.270171 Jul 07 10:26:24.988093 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 29/54] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:24 2022] GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:25.210537 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-92c370ed-10db-4af6-9c48-44d20857307f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:25.211699 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-92c370ed-10db-4af6-9c48-44d20857307f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:25.221383 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-92c370ed-10db-4af6-9c48-44d20857307f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:25.222100 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-92c370ed-10db-4af6-9c48-44d20857307f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:25.222985 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-92c370ed-10db-4af6-9c48-44d20857307f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:25.223560 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-92c370ed-10db-4af6-9c48-44d20857307f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:25.540452 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-c7bfce47-b48d-47fa-aa31-31c992dbddd4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:25.541111 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-c7bfce47-b48d-47fa-aa31-31c992dbddd4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:25.550047 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c7bfce47-b48d-47fa-aa31-31c992dbddd4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:25.550734 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c7bfce47-b48d-47fa-aa31-31c992dbddd4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:25.551765 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c7bfce47-b48d-47fa-aa31-31c992dbddd4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:25.552356 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c7bfce47-b48d-47fa-aa31-31c992dbddd4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:25.693412 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-92c370ed-10db-4af6-9c48-44d20857307f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:25.721798 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-92c370ed-10db-4af6-9c48-44d20857307f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1322 microversion: 2.1 time: 0.509897 Jul 07 10:26:25.726295 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 26/55] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:25 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1322 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:25.855289 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-c7bfce47-b48d-47fa-aa31-31c992dbddd4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:25.863498 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-c7bfce47-b48d-47fa-aa31-31c992dbddd4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1363 microversion: 2.1 time: 0.333315 Jul 07 10:26:25.865452 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 30/56] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:25 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1363 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:26.006270 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6f55e4ce-76e9-43fe-85a8-ff8fb47039b2 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:26.007307 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6f55e4ce-76e9-43fe-85a8-ff8fb47039b2 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:26.016702 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6f55e4ce-76e9-43fe-85a8-ff8fb47039b2 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:26.017412 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6f55e4ce-76e9-43fe-85a8-ff8fb47039b2 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:26.018349 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6f55e4ce-76e9-43fe-85a8-ff8fb47039b2 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:26.018865 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6f55e4ce-76e9-43fe-85a8-ff8fb47039b2 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:26.043247 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=100 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:26:26.222390 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6f55e4ce-76e9-43fe-85a8-ff8fb47039b2 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730e7d9b92c84bd5872bc0e221b616cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c765bc215964bce8a321b4f3d085ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:26.231764 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6f55e4ce-76e9-43fe-85a8-ff8fb47039b2 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 200 len: 1315 microversion: 2.1 time: 0.231184 Jul 07 10:26:26.232918 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 27/57] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:25 2022] GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:26.742633 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-f736675a-a03e-40b1-b380-8e977a6b3656 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:26.743299 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-f736675a-a03e-40b1-b380-8e977a6b3656 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:26.751273 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f736675a-a03e-40b1-b380-8e977a6b3656 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:26.752083 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f736675a-a03e-40b1-b380-8e977a6b3656 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:26.753423 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f736675a-a03e-40b1-b380-8e977a6b3656 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:26.754062 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f736675a-a03e-40b1-b380-8e977a6b3656 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:26.786569 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=100 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:26:26.885347 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-aff76c77-3188-44af-b727-9898a057f90e tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:26.887389 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-aff76c77-3188-44af-b727-9898a057f90e tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:26.896981 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-aff76c77-3188-44af-b727-9898a057f90e tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:26.897896 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-aff76c77-3188-44af-b727-9898a057f90e tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:26.899416 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-aff76c77-3188-44af-b727-9898a057f90e tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:26.900426 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-aff76c77-3188-44af-b727-9898a057f90e tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:26.906467 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-f736675a-a03e-40b1-b380-8e977a6b3656 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:26.915173 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-f736675a-a03e-40b1-b380-8e977a6b3656 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1322 microversion: 2.1 time: 0.176536 Jul 07 10:26:26.924963 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 31/58] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:26 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:27.099207 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-aff76c77-3188-44af-b727-9898a057f90e tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:27.111763 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-aff76c77-3188-44af-b727-9898a057f90e tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1363 microversion: 2.1 time: 0.232444 Jul 07 10:26:27.113164 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 28/59] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:26 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:27.249138 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-0fe809d8-68ed-4468-914f-da8d63ede2ed tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:27.250223 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-0fe809d8-68ed-4468-914f-da8d63ede2ed tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:27.257407 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0fe809d8-68ed-4468-914f-da8d63ede2ed tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:27.262863 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0fe809d8-68ed-4468-914f-da8d63ede2ed tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:27.264011 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0fe809d8-68ed-4468-914f-da8d63ede2ed tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:27.266466 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0fe809d8-68ed-4468-914f-da8d63ede2ed tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:27.497121 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-0fe809d8-68ed-4468-914f-da8d63ede2ed tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730e7d9b92c84bd5872bc0e221b616cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c765bc215964bce8a321b4f3d085ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:27.519872 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-0fe809d8-68ed-4468-914f-da8d63ede2ed tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 200 len: 1315 microversion: 2.1 time: 0.274424 Jul 07 10:26:27.531278 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 32/60] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:27 2022] GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:27.935061 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-67516b50-8cf2-44b6-ae47-1154dd66fb07 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:27.936031 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-67516b50-8cf2-44b6-ae47-1154dd66fb07 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:27.938639 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=8 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:26:27.939383 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:26:27.947576 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-67516b50-8cf2-44b6-ae47-1154dd66fb07 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:27.948003 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-67516b50-8cf2-44b6-ae47-1154dd66fb07 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:27.948825 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-67516b50-8cf2-44b6-ae47-1154dd66fb07 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:27.949262 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-67516b50-8cf2-44b6-ae47-1154dd66fb07 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:28.129053 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-567b4ca1-882c-4355-88a6-bdf38a1e0a80 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:28.129666 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-567b4ca1-882c-4355-88a6-bdf38a1e0a80 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:28.139601 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-567b4ca1-882c-4355-88a6-bdf38a1e0a80 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:28.141217 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-567b4ca1-882c-4355-88a6-bdf38a1e0a80 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:28.145459 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-567b4ca1-882c-4355-88a6-bdf38a1e0a80 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:28.146896 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-567b4ca1-882c-4355-88a6-bdf38a1e0a80 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:28.188799 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-67516b50-8cf2-44b6-ae47-1154dd66fb07 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:28.211315 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-67516b50-8cf2-44b6-ae47-1154dd66fb07 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1322 microversion: 2.1 time: 0.280768 Jul 07 10:26:28.212314 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 29/61] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:27 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:28.396894 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-567b4ca1-882c-4355-88a6-bdf38a1e0a80 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:28.406437 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-567b4ca1-882c-4355-88a6-bdf38a1e0a80 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1363 microversion: 2.1 time: 0.281164 Jul 07 10:26:28.408791 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 33/62] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:28 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1363 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:26:28.538582 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-752eb31a-acb4-4874-8a2e-f4455bb3293c tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:28.539206 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-752eb31a-acb4-4874-8a2e-f4455bb3293c tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:28.546515 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-752eb31a-acb4-4874-8a2e-f4455bb3293c tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:28.546972 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-752eb31a-acb4-4874-8a2e-f4455bb3293c tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:28.547962 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-752eb31a-acb4-4874-8a2e-f4455bb3293c tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:28.548401 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-752eb31a-acb4-4874-8a2e-f4455bb3293c tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:28.710814 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-752eb31a-acb4-4874-8a2e-f4455bb3293c tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730e7d9b92c84bd5872bc0e221b616cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c765bc215964bce8a321b4f3d085ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:28.720808 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-752eb31a-acb4-4874-8a2e-f4455bb3293c tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 200 len: 1315 microversion: 2.1 time: 0.186066 Jul 07 10:26:28.721855 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 30/63] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:28 2022] GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:29.228828 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-2c8d7331-51b6-45ad-bdff-8bb36e8eed7f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:29.230758 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-2c8d7331-51b6-45ad-bdff-8bb36e8eed7f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:29.232877 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:26:29.238306 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2c8d7331-51b6-45ad-bdff-8bb36e8eed7f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:29.238739 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2c8d7331-51b6-45ad-bdff-8bb36e8eed7f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:29.239578 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2c8d7331-51b6-45ad-bdff-8bb36e8eed7f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:29.240037 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2c8d7331-51b6-45ad-bdff-8bb36e8eed7f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:29.388541 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-2c8d7331-51b6-45ad-bdff-8bb36e8eed7f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:29.399415 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-2c8d7331-51b6-45ad-bdff-8bb36e8eed7f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1322 microversion: 2.1 time: 0.174476 Jul 07 10:26:29.408607 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 34/64] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:29 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:29.424065 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6965a829-0a40-4a1f-b6ab-7ab0efe2e4c1 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:29.424608 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6965a829-0a40-4a1f-b6ab-7ab0efe2e4c1 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:29.435204 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6965a829-0a40-4a1f-b6ab-7ab0efe2e4c1 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:29.435765 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6965a829-0a40-4a1f-b6ab-7ab0efe2e4c1 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:29.436534 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6965a829-0a40-4a1f-b6ab-7ab0efe2e4c1 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:29.436974 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6965a829-0a40-4a1f-b6ab-7ab0efe2e4c1 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:29.738605 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-f11e5131-ef18-433e-b415-9e0e69170f16 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:29.740208 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-f11e5131-ef18-433e-b415-9e0e69170f16 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:29.748705 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f11e5131-ef18-433e-b415-9e0e69170f16 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:29.749872 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f11e5131-ef18-433e-b415-9e0e69170f16 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:29.751672 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f11e5131-ef18-433e-b415-9e0e69170f16 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:29.752335 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f11e5131-ef18-433e-b415-9e0e69170f16 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:30.145552 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-f11e5131-ef18-433e-b415-9e0e69170f16 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730e7d9b92c84bd5872bc0e221b616cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c765bc215964bce8a321b4f3d085ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:30.158643 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-f11e5131-ef18-433e-b415-9e0e69170f16 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 200 len: 1315 microversion: 2.1 time: 0.423978 Jul 07 10:26:30.170896 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 35/65] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:29 2022] GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 1315 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:26:30.418631 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-e2c1528a-2ff5-461e-902d-4133e6440cc4 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:30.419274 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-e2c1528a-2ff5-461e-902d-4133e6440cc4 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:30.431233 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e2c1528a-2ff5-461e-902d-4133e6440cc4 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:30.433461 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e2c1528a-2ff5-461e-902d-4133e6440cc4 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:30.437272 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e2c1528a-2ff5-461e-902d-4133e6440cc4 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:30.437920 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e2c1528a-2ff5-461e-902d-4133e6440cc4 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:30.455054 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6965a829-0a40-4a1f-b6ab-7ab0efe2e4c1 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:30.466326 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6965a829-0a40-4a1f-b6ab-7ab0efe2e4c1 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1363 microversion: 2.1 time: 1.044851 Jul 07 10:26:30.467268 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 31/66] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:29 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1363 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:30.657072 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-e2c1528a-2ff5-461e-902d-4133e6440cc4 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:30.665360 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-e2c1528a-2ff5-461e-902d-4133e6440cc4 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1322 microversion: 2.1 time: 0.253449 Jul 07 10:26:30.665934 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 36/67] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:30 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:26:31.178719 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5c96d0dd-bbef-49fb-82f4-7e2ca8dd48ff tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:31.179343 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5c96d0dd-bbef-49fb-82f4-7e2ca8dd48ff tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:31.185501 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5c96d0dd-bbef-49fb-82f4-7e2ca8dd48ff tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:31.186132 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5c96d0dd-bbef-49fb-82f4-7e2ca8dd48ff tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:31.187122 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5c96d0dd-bbef-49fb-82f4-7e2ca8dd48ff tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:31.187627 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5c96d0dd-bbef-49fb-82f4-7e2ca8dd48ff tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:31.343878 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5c96d0dd-bbef-49fb-82f4-7e2ca8dd48ff tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730e7d9b92c84bd5872bc0e221b616cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c765bc215964bce8a321b4f3d085ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:31.351407 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5c96d0dd-bbef-49fb-82f4-7e2ca8dd48ff tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 200 len: 1315 microversion: 2.1 time: 0.176899 Jul 07 10:26:31.352108 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 32/68] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:31 2022] GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:31.484989 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-1fc96f41-4269-45c3-b0f0-d4c2ccc3a2ab tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:31.485749 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-1fc96f41-4269-45c3-b0f0-d4c2ccc3a2ab tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:31.489061 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell0:SELECT=2 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:26:31.500825 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1fc96f41-4269-45c3-b0f0-d4c2ccc3a2ab tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:31.501335 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1fc96f41-4269-45c3-b0f0-d4c2ccc3a2ab tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:31.502242 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1fc96f41-4269-45c3-b0f0-d4c2ccc3a2ab tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:31.502694 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1fc96f41-4269-45c3-b0f0-d4c2ccc3a2ab tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:31.669514 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-1fc96f41-4269-45c3-b0f0-d4c2ccc3a2ab tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:31.677663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-1fc96f41-4269-45c3-b0f0-d4c2ccc3a2ab tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1363 microversion: 2.1 time: 0.196595 Jul 07 10:26:31.678431 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 37/69] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:31 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:31.687088 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-766f79ee-09f7-4a99-a947-3f46b620dbf5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:31.687088 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-766f79ee-09f7-4a99-a947-3f46b620dbf5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:31.690060 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-766f79ee-09f7-4a99-a947-3f46b620dbf5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:31.690576 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-766f79ee-09f7-4a99-a947-3f46b620dbf5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:31.691535 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-766f79ee-09f7-4a99-a947-3f46b620dbf5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:31.692190 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-766f79ee-09f7-4a99-a947-3f46b620dbf5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:31.831578 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-766f79ee-09f7-4a99-a947-3f46b620dbf5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:31.839696 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-766f79ee-09f7-4a99-a947-3f46b620dbf5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1322 microversion: 2.1 time: 0.161418 Jul 07 10:26:31.844392 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 33/70] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:31 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:26:32.369191 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-c4db05f9-be45-4494-bf27-566b3e0a527c tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:32.369797 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-c4db05f9-be45-4494-bf27-566b3e0a527c tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:32.378074 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c4db05f9-be45-4494-bf27-566b3e0a527c tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:32.378074 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c4db05f9-be45-4494-bf27-566b3e0a527c tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:32.378074 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c4db05f9-be45-4494-bf27-566b3e0a527c tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:32.378524 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c4db05f9-be45-4494-bf27-566b3e0a527c tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:32.518460 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-c4db05f9-be45-4494-bf27-566b3e0a527c tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730e7d9b92c84bd5872bc0e221b616cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c765bc215964bce8a321b4f3d085ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:32.526904 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-c4db05f9-be45-4494-bf27-566b3e0a527c tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 200 len: 1315 microversion: 2.1 time: 0.161382 Jul 07 10:26:32.527675 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 38/71] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:32 2022] GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:32.694512 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ce775471-f611-4fa1-8764-123411a565b9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:32.695390 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ce775471-f611-4fa1-8764-123411a565b9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:32.701846 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ce775471-f611-4fa1-8764-123411a565b9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:32.702483 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ce775471-f611-4fa1-8764-123411a565b9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:32.703428 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ce775471-f611-4fa1-8764-123411a565b9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:32.704074 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ce775471-f611-4fa1-8764-123411a565b9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:32.834073 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-4816063d-1575-47eb-913f-aedfc391676f req-3ad46abb-9135-4182-aa77-569ddbde51be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11", "name": "network-vif-plugged", "status": "completed", "tag": "4af65680-4c8a-4420-938b-02b9403f177e"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:26:32.842899 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-4816063d-1575-47eb-913f-aedfc391676f req-3ad46abb-9135-4182-aa77-569ddbde51be service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:32.843437 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-4816063d-1575-47eb-913f-aedfc391676f req-3ad46abb-9135-4182-aa77-569ddbde51be service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:32.855313 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-4816063d-1575-47eb-913f-aedfc391676f req-3ad46abb-9135-4182-aa77-569ddbde51be service nova] Creating event network-vif-plugged:4af65680-4c8a-4420-938b-02b9403f177e for instance 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 on hv-cinder-82282 Jul 07 10:26:32.860508 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-4816063d-1575-47eb-913f-aedfc391676f req-3ad46abb-9135-4182-aa77-569ddbde51be service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087695 Jul 07 10:26:32.861184 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 39/72] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 10:26:32.866578 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-26cb678b-be1c-4980-9a94-86ef95c28632 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:32.867268 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-26cb678b-be1c-4980-9a94-86ef95c28632 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:32.873467 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-26cb678b-be1c-4980-9a94-86ef95c28632 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:32.873924 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-26cb678b-be1c-4980-9a94-86ef95c28632 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:32.874695 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-26cb678b-be1c-4980-9a94-86ef95c28632 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:32.875130 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-26cb678b-be1c-4980-9a94-86ef95c28632 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:32.902882 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ce775471-f611-4fa1-8764-123411a565b9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:32.910935 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ce775471-f611-4fa1-8764-123411a565b9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1363 microversion: 2.1 time: 0.220356 Jul 07 10:26:32.911511 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 34/73] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:32 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:33.018887 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-26cb678b-be1c-4980-9a94-86ef95c28632 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:33.027346 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-26cb678b-be1c-4980-9a94-86ef95c28632 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1322 microversion: 2.1 time: 0.164333 Jul 07 10:26:33.027983 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 40/74] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:32 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:33.543379 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-22e6dc19-bd10-4dae-a70b-577e69e8694e tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:33.544013 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-22e6dc19-bd10-4dae-a70b-577e69e8694e tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:33.549934 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-22e6dc19-bd10-4dae-a70b-577e69e8694e tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:33.550386 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-22e6dc19-bd10-4dae-a70b-577e69e8694e tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:33.551140 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-22e6dc19-bd10-4dae-a70b-577e69e8694e tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:33.551572 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-22e6dc19-bd10-4dae-a70b-577e69e8694e tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:33.698645 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-22e6dc19-bd10-4dae-a70b-577e69e8694e tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730e7d9b92c84bd5872bc0e221b616cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c765bc215964bce8a321b4f3d085ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:33.706061 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-22e6dc19-bd10-4dae-a70b-577e69e8694e tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 200 len: 1315 microversion: 2.1 time: 0.166579 Jul 07 10:26:33.706631 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 35/75] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:33 2022] GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:33.928394 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-6049d33f-33a5-429a-9cb4-0356c1e24894 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:33.929000 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-6049d33f-33a5-429a-9cb4-0356c1e24894 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:33.935240 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6049d33f-33a5-429a-9cb4-0356c1e24894 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:33.935400 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6049d33f-33a5-429a-9cb4-0356c1e24894 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:33.936195 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6049d33f-33a5-429a-9cb4-0356c1e24894 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:33.936630 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6049d33f-33a5-429a-9cb4-0356c1e24894 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:34.044349 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d193a6ee-b041-4717-ad7d-e064d73dba79 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:34.045095 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d193a6ee-b041-4717-ad7d-e064d73dba79 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:34.051244 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d193a6ee-b041-4717-ad7d-e064d73dba79 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:34.051900 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d193a6ee-b041-4717-ad7d-e064d73dba79 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:34.052839 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d193a6ee-b041-4717-ad7d-e064d73dba79 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:34.053434 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d193a6ee-b041-4717-ad7d-e064d73dba79 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:34.066203 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-6049d33f-33a5-429a-9cb4-0356c1e24894 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:34.075968 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-6049d33f-33a5-429a-9cb4-0356c1e24894 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1363 microversion: 2.1 time: 0.150204 Jul 07 10:26:34.075968 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 41/76] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:33 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:34.189589 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d193a6ee-b041-4717-ad7d-e064d73dba79 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:34.197723 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d193a6ee-b041-4717-ad7d-e064d73dba79 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1322 microversion: 2.1 time: 0.156975 Jul 07 10:26:34.199232 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 36/77] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:34 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:26:34.722939 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-6625f7b6-cbee-45ac-abec-4510703b2667 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:34.723973 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-6625f7b6-cbee-45ac-abec-4510703b2667 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:34.732896 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6625f7b6-cbee-45ac-abec-4510703b2667 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:34.733830 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6625f7b6-cbee-45ac-abec-4510703b2667 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:34.734947 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6625f7b6-cbee-45ac-abec-4510703b2667 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:34.735646 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6625f7b6-cbee-45ac-abec-4510703b2667 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:34.975534 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-6625f7b6-cbee-45ac-abec-4510703b2667 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730e7d9b92c84bd5872bc0e221b616cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c765bc215964bce8a321b4f3d085ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:34.990317 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-6625f7b6-cbee-45ac-abec-4510703b2667 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 200 len: 1315 microversion: 2.1 time: 0.271191 Jul 07 10:26:34.990908 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 42/78] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:34 2022] GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:35.095858 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-53e72983-3818-4ef8-a639-4935281316dc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:35.099416 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-53e72983-3818-4ef8-a639-4935281316dc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:35.107485 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-53e72983-3818-4ef8-a639-4935281316dc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:35.108213 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-53e72983-3818-4ef8-a639-4935281316dc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:35.109481 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-53e72983-3818-4ef8-a639-4935281316dc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:35.110147 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-53e72983-3818-4ef8-a639-4935281316dc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:35.216730 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-fa002137-1613-4950-89f7-62319ce63c84 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:35.218583 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-fa002137-1613-4950-89f7-62319ce63c84 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:35.226241 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fa002137-1613-4950-89f7-62319ce63c84 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:35.226954 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fa002137-1613-4950-89f7-62319ce63c84 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:35.228104 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fa002137-1613-4950-89f7-62319ce63c84 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:35.228863 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fa002137-1613-4950-89f7-62319ce63c84 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:35.419613 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-fa002137-1613-4950-89f7-62319ce63c84 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:35.429268 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-fa002137-1613-4950-89f7-62319ce63c84 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1322 microversion: 2.1 time: 0.216861 Jul 07 10:26:35.429890 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 43/79] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:35 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:35.645858 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-53e72983-3818-4ef8-a639-4935281316dc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:35.662739 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-53e72983-3818-4ef8-a639-4935281316dc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1363 microversion: 2.1 time: 0.574748 Jul 07 10:26:35.664343 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 37/80] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:35 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1363 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:36.007776 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-b5110a51-7965-4c10-babc-b06bf6c04aef tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:36.009223 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-b5110a51-7965-4c10-babc-b06bf6c04aef tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:36.015691 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b5110a51-7965-4c10-babc-b06bf6c04aef tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:36.016302 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b5110a51-7965-4c10-babc-b06bf6c04aef tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:36.017201 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b5110a51-7965-4c10-babc-b06bf6c04aef tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:36.017700 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b5110a51-7965-4c10-babc-b06bf6c04aef tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:36.166279 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-b5110a51-7965-4c10-babc-b06bf6c04aef tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730e7d9b92c84bd5872bc0e221b616cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c765bc215964bce8a321b4f3d085ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:36.174606 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-b5110a51-7965-4c10-babc-b06bf6c04aef tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 200 len: 1315 microversion: 2.1 time: 0.171242 Jul 07 10:26:36.175205 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 44/81] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:36 2022] GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:36.448765 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0d707584-5ce6-4118-a049-02a2d369fa78 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:36.450486 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0d707584-5ce6-4118-a049-02a2d369fa78 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:36.460263 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0d707584-5ce6-4118-a049-02a2d369fa78 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:36.460954 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0d707584-5ce6-4118-a049-02a2d369fa78 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:36.462513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0d707584-5ce6-4118-a049-02a2d369fa78 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:36.464510 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0d707584-5ce6-4118-a049-02a2d369fa78 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:36.532740 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-1a62d178-662f-44e8-a6d3-8947b829c37e req-50fb5022-d82c-4e27-a5ae-226debb250a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e45c86-fe48-454c-8b7e-3e03765d79c1", "name": "network-vif-plugged", "status": "completed", "tag": "3f5c850a-9465-4487-9bb2-f2d849e2ab3d"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:26:36.544992 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-1a62d178-662f-44e8-a6d3-8947b829c37e req-50fb5022-d82c-4e27-a5ae-226debb250a1 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:36.545614 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-1a62d178-662f-44e8-a6d3-8947b829c37e req-50fb5022-d82c-4e27-a5ae-226debb250a1 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:36.557172 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-1a62d178-662f-44e8-a6d3-8947b829c37e req-50fb5022-d82c-4e27-a5ae-226debb250a1 service nova] Creating event network-vif-plugged:3f5c850a-9465-4487-9bb2-f2d849e2ab3d for instance 08e45c86-fe48-454c-8b7e-3e03765d79c1 on hv-cinder-82282 Jul 07 10:26:36.563327 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-1a62d178-662f-44e8-a6d3-8947b829c37e req-50fb5022-d82c-4e27-a5ae-226debb250a1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041419 Jul 07 10:26:36.564056 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 45/82] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 10:26:36.627328 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0d707584-5ce6-4118-a049-02a2d369fa78 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:36.634806 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0d707584-5ce6-4118-a049-02a2d369fa78 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1322 microversion: 2.1 time: 0.192198 Jul 07 10:26:36.635371 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 38/83] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:36 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:36.680773 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-2d34f934-9b15-41e9-9b74-4247cacdf1e2 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:36.681474 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-2d34f934-9b15-41e9-9b74-4247cacdf1e2 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:36.688294 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2d34f934-9b15-41e9-9b74-4247cacdf1e2 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:36.688801 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2d34f934-9b15-41e9-9b74-4247cacdf1e2 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:36.689610 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2d34f934-9b15-41e9-9b74-4247cacdf1e2 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:36.690052 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2d34f934-9b15-41e9-9b74-4247cacdf1e2 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:36.884551 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-2d34f934-9b15-41e9-9b74-4247cacdf1e2 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:36.896863 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-2d34f934-9b15-41e9-9b74-4247cacdf1e2 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1363 microversion: 2.1 time: 0.219984 Jul 07 10:26:36.897730 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 46/84] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:36 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:37.193435 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-97a8c930-6940-4a0f-8e49-9dad06aefc53 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:37.194290 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-97a8c930-6940-4a0f-8e49-9dad06aefc53 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:37.201968 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-97a8c930-6940-4a0f-8e49-9dad06aefc53 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:37.202416 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-97a8c930-6940-4a0f-8e49-9dad06aefc53 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:37.203181 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-97a8c930-6940-4a0f-8e49-9dad06aefc53 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:37.203611 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-97a8c930-6940-4a0f-8e49-9dad06aefc53 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:37.378479 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-97a8c930-6940-4a0f-8e49-9dad06aefc53 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730e7d9b92c84bd5872bc0e221b616cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c765bc215964bce8a321b4f3d085ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:37.387332 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-97a8c930-6940-4a0f-8e49-9dad06aefc53 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 200 len: 1315 microversion: 2.1 time: 0.198034 Jul 07 10:26:37.388180 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 39/85] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:37 2022] GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:37.653029 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-6b3b9fd3-ae01-40dc-a7d2-5adfef361c2e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:37.653728 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-6b3b9fd3-ae01-40dc-a7d2-5adfef361c2e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:37.662020 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6b3b9fd3-ae01-40dc-a7d2-5adfef361c2e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:37.662528 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6b3b9fd3-ae01-40dc-a7d2-5adfef361c2e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:37.663312 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6b3b9fd3-ae01-40dc-a7d2-5adfef361c2e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:37.663996 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6b3b9fd3-ae01-40dc-a7d2-5adfef361c2e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:37.910918 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-6b3b9fd3-ae01-40dc-a7d2-5adfef361c2e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:37.924445 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8cdb3b56-8f77-4719-9980-dda5f666f3c4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:37.926348 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8cdb3b56-8f77-4719-9980-dda5f666f3c4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:37.941178 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-6b3b9fd3-ae01-40dc-a7d2-5adfef361c2e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1322 microversion: 2.1 time: 0.292641 Jul 07 10:26:37.942633 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 47/86] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:37 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:37.943006 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8cdb3b56-8f77-4719-9980-dda5f666f3c4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:37.943869 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8cdb3b56-8f77-4719-9980-dda5f666f3c4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:37.945307 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8cdb3b56-8f77-4719-9980-dda5f666f3c4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:37.947694 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8cdb3b56-8f77-4719-9980-dda5f666f3c4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:38.403388 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-42b0f865-7e7a-40b5-a9f3-0c1e9a14df63 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:38.404329 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-42b0f865-7e7a-40b5-a9f3-0c1e9a14df63 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:38.410641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-42b0f865-7e7a-40b5-a9f3-0c1e9a14df63 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:38.411360 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-42b0f865-7e7a-40b5-a9f3-0c1e9a14df63 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:38.412542 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-42b0f865-7e7a-40b5-a9f3-0c1e9a14df63 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:38.413213 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-42b0f865-7e7a-40b5-a9f3-0c1e9a14df63 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:38.439351 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8cdb3b56-8f77-4719-9980-dda5f666f3c4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:38.454593 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8cdb3b56-8f77-4719-9980-dda5f666f3c4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1363 microversion: 2.1 time: 0.538486 Jul 07 10:26:38.455493 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 40/87] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:37 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1363 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:38.633255 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-42b0f865-7e7a-40b5-a9f3-0c1e9a14df63 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730e7d9b92c84bd5872bc0e221b616cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c765bc215964bce8a321b4f3d085ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:38.642082 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-42b0f865-7e7a-40b5-a9f3-0c1e9a14df63 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 200 len: 1315 microversion: 2.1 time: 0.242528 Jul 07 10:26:38.643059 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 48/88] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:38 2022] GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:38.962287 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8e3cac1d-d17a-4225-9c27-88e0149760cb tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:38.964514 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8e3cac1d-d17a-4225-9c27-88e0149760cb tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:38.973281 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8e3cac1d-d17a-4225-9c27-88e0149760cb tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:38.974014 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8e3cac1d-d17a-4225-9c27-88e0149760cb tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:38.974970 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8e3cac1d-d17a-4225-9c27-88e0149760cb tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:38.975631 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8e3cac1d-d17a-4225-9c27-88e0149760cb tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:39.239616 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8e3cac1d-d17a-4225-9c27-88e0149760cb tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:39.248646 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8e3cac1d-d17a-4225-9c27-88e0149760cb tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1322 microversion: 2.1 time: 0.292282 Jul 07 10:26:39.251941 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 41/89] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:38 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:39.475387 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-6b4734ec-35c3-474b-93f2-057db49ef003 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:39.476021 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-6b4734ec-35c3-474b-93f2-057db49ef003 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:39.488318 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6b4734ec-35c3-474b-93f2-057db49ef003 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:39.488763 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6b4734ec-35c3-474b-93f2-057db49ef003 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:39.489992 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6b4734ec-35c3-474b-93f2-057db49ef003 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:39.490567 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6b4734ec-35c3-474b-93f2-057db49ef003 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:39.548538 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=100 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:26:39.660972 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-7032329d-ba02-4db6-bd24-dd88225b87ad tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:39.661832 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-7032329d-ba02-4db6-bd24-dd88225b87ad tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:39.668945 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7032329d-ba02-4db6-bd24-dd88225b87ad tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:39.669765 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7032329d-ba02-4db6-bd24-dd88225b87ad tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:39.670939 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7032329d-ba02-4db6-bd24-dd88225b87ad tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:39.671592 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7032329d-ba02-4db6-bd24-dd88225b87ad tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:39.689164 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-6b4734ec-35c3-474b-93f2-057db49ef003 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:39.700500 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-6b4734ec-35c3-474b-93f2-057db49ef003 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1363 microversion: 2.1 time: 0.231407 Jul 07 10:26:39.702035 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 49/90] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:39 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:39.855274 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-7032329d-ba02-4db6-bd24-dd88225b87ad tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730e7d9b92c84bd5872bc0e221b616cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c765bc215964bce8a321b4f3d085ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:39.866692 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-7032329d-ba02-4db6-bd24-dd88225b87ad tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 200 len: 1315 microversion: 2.1 time: 0.209871 Jul 07 10:26:39.867824 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 42/91] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:39 2022] GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:40.265774 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-67016d24-50ae-412b-865b-a82b0beb0900 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:40.266759 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-67016d24-50ae-412b-865b-a82b0beb0900 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:40.275158 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-67016d24-50ae-412b-865b-a82b0beb0900 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:40.275617 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-67016d24-50ae-412b-865b-a82b0beb0900 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:40.276476 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-67016d24-50ae-412b-865b-a82b0beb0900 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:40.276921 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-67016d24-50ae-412b-865b-a82b0beb0900 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:40.487844 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-67016d24-50ae-412b-865b-a82b0beb0900 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:40.501287 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-67016d24-50ae-412b-865b-a82b0beb0900 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1322 microversion: 2.1 time: 0.237849 Jul 07 10:26:40.502840 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 50/92] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:40 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:40.518155 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-d1161695-5529-407d-9354-8f6f548d167a req-bd61fa07-b28f-4b4a-baae-be60a2da9bad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b00a3c72-669b-41e2-a9b9-1a2921bcabe0", "name": "network-vif-plugged", "status": "completed", "tag": "ab69b298-c3d4-4702-89eb-78fe3392b9f5"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:26:40.528628 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-d1161695-5529-407d-9354-8f6f548d167a req-bd61fa07-b28f-4b4a-baae-be60a2da9bad service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:40.529666 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-d1161695-5529-407d-9354-8f6f548d167a req-bd61fa07-b28f-4b4a-baae-be60a2da9bad service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:40.542250 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-d1161695-5529-407d-9354-8f6f548d167a req-bd61fa07-b28f-4b4a-baae-be60a2da9bad service nova] Creating event network-vif-plugged:ab69b298-c3d4-4702-89eb-78fe3392b9f5 for instance b00a3c72-669b-41e2-a9b9-1a2921bcabe0 on hv-cinder-82282 Jul 07 10:26:40.550109 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-d1161695-5529-407d-9354-8f6f548d167a req-bd61fa07-b28f-4b4a-baae-be60a2da9bad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049070 Jul 07 10:26:40.551146 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 43/93] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:26:40.718512 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-dc6a7f65-44e3-471f-8496-10a090acd414 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:40.719129 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-dc6a7f65-44e3-471f-8496-10a090acd414 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:40.725501 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-dc6a7f65-44e3-471f-8496-10a090acd414 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:40.726133 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-dc6a7f65-44e3-471f-8496-10a090acd414 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:40.727218 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-dc6a7f65-44e3-471f-8496-10a090acd414 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:40.727835 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-dc6a7f65-44e3-471f-8496-10a090acd414 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:40.882947 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-dc6a7f65-44e3-471f-8496-10a090acd414 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:40.885949 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0ca7442e-94d3-42f6-b8f1-9b5ec76dbc03 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:40.887364 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0ca7442e-94d3-42f6-b8f1-9b5ec76dbc03 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:40.890964 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-dc6a7f65-44e3-471f-8496-10a090acd414 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1363 microversion: 2.1 time: 0.176761 Jul 07 10:26:40.899968 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 51/94] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:40 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:40.904534 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0ca7442e-94d3-42f6-b8f1-9b5ec76dbc03 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:40.905204 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0ca7442e-94d3-42f6-b8f1-9b5ec76dbc03 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:40.906143 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0ca7442e-94d3-42f6-b8f1-9b5ec76dbc03 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:40.906788 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0ca7442e-94d3-42f6-b8f1-9b5ec76dbc03 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:41.058879 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0ca7442e-94d3-42f6-b8f1-9b5ec76dbc03 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730e7d9b92c84bd5872bc0e221b616cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c765bc215964bce8a321b4f3d085ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:41.063390 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=100 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:26:41.068806 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0ca7442e-94d3-42f6-b8f1-9b5ec76dbc03 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 200 len: 1315 microversion: 2.1 time: 0.188341 Jul 07 10:26:41.070655 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 44/95] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:40 2022] GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:26:41.518613 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-35bdf999-7405-4b7a-8989-107ef7747392 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:41.519147 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-35bdf999-7405-4b7a-8989-107ef7747392 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:41.526237 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-35bdf999-7405-4b7a-8989-107ef7747392 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:41.527202 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-35bdf999-7405-4b7a-8989-107ef7747392 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:41.527999 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-35bdf999-7405-4b7a-8989-107ef7747392 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:41.528433 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-35bdf999-7405-4b7a-8989-107ef7747392 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:41.684788 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-35bdf999-7405-4b7a-8989-107ef7747392 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:41.693372 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-35bdf999-7405-4b7a-8989-107ef7747392 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1322 microversion: 2.1 time: 0.178519 Jul 07 10:26:41.694057 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 52/96] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:41 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:41.907592 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2ece8d4f-3427-4acf-a759-3dd829ea114d tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:41.908419 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-2ece8d4f-3427-4acf-a759-3dd829ea114d tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:41.914617 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2ece8d4f-3427-4acf-a759-3dd829ea114d tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:41.915137 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2ece8d4f-3427-4acf-a759-3dd829ea114d tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:41.916180 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2ece8d4f-3427-4acf-a759-3dd829ea114d tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:41.916721 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2ece8d4f-3427-4acf-a759-3dd829ea114d tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:42.091583 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-8594a0ff-ff63-4886-bf28-3f2fb520b507 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:42.092925 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-8594a0ff-ff63-4886-bf28-3f2fb520b507 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:42.106050 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8594a0ff-ff63-4886-bf28-3f2fb520b507 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:42.107835 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8594a0ff-ff63-4886-bf28-3f2fb520b507 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:42.111431 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8594a0ff-ff63-4886-bf28-3f2fb520b507 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:42.114054 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8594a0ff-ff63-4886-bf28-3f2fb520b507 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:42.175301 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-2ece8d4f-3427-4acf-a759-3dd829ea114d tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:42.188329 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-2ece8d4f-3427-4acf-a759-3dd829ea114d tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1363 microversion: 2.1 time: 0.284593 Jul 07 10:26:42.197736 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 45/97] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:41 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1363 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:42.329121 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-8594a0ff-ff63-4886-bf28-3f2fb520b507 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730e7d9b92c84bd5872bc0e221b616cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c765bc215964bce8a321b4f3d085ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:42.340531 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-8594a0ff-ff63-4886-bf28-3f2fb520b507 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 200 len: 1502 microversion: 2.1 time: 0.254520 Jul 07 10:26:42.341944 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 53/98] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:42 2022] GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 1502 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:26:42.710764 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-24f91ea3-fe64-4edc-a477-4b9ed614c0f9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:42.711375 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-24f91ea3-fe64-4edc-a477-4b9ed614c0f9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:42.718755 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-24f91ea3-fe64-4edc-a477-4b9ed614c0f9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:42.719449 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-24f91ea3-fe64-4edc-a477-4b9ed614c0f9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:42.720451 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-24f91ea3-fe64-4edc-a477-4b9ed614c0f9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:42.720943 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-24f91ea3-fe64-4edc-a477-4b9ed614c0f9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:42.918578 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-24f91ea3-fe64-4edc-a477-4b9ed614c0f9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:42.931002 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-24f91ea3-fe64-4edc-a477-4b9ed614c0f9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1516 microversion: 2.1 time: 0.224076 Jul 07 10:26:42.932798 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 46/99] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:42 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1516 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:42.972897 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-c73f33fa-311d-4ba7-8606-d73b4c64c454 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:26:42.973379 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-c73f33fa-311d-4ba7-8606-d73b4c64c454 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:42.992242 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c73f33fa-311d-4ba7-8606-d73b4c64c454 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:42.993094 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c73f33fa-311d-4ba7-8606-d73b4c64c454 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:42.998047 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c73f33fa-311d-4ba7-8606-d73b4c64c454 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:42.998716 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c73f33fa-311d-4ba7-8606-d73b4c64c454 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:43.084703 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.objects.instance [None req-c73f33fa-311d-4ba7-8606-d73b4c64c454 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lazy-loading 'flavor' on Instance uuid 08e45c86-fe48-454c-8b7e-3e03765d79c1 {{(pid=117646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 10:26:43.205625 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2962179b-5ebc-4cdc-b1d9-02cf871a9670 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:43.206289 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-2962179b-5ebc-4cdc-b1d9-02cf871a9670 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:43.213548 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2962179b-5ebc-4cdc-b1d9-02cf871a9670 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:43.214264 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2962179b-5ebc-4cdc-b1d9-02cf871a9670 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:43.215224 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2962179b-5ebc-4cdc-b1d9-02cf871a9670 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:43.215864 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2962179b-5ebc-4cdc-b1d9-02cf871a9670 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:43.290710 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-c73f33fa-311d-4ba7-8606-d73b4c64c454 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "POST /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1/action" status: 200 len: 32 microversion: 2.1 time: 0.340295 Jul 07 10:26:43.294032 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 54/100] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Jul 7 10:26:42 2022] POST /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1/action => generated 32 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 10:26:43.310100 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-0bca2ed4-48d1-4a92-a17e-cbda47a8524c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:43.311444 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-0bca2ed4-48d1-4a92-a17e-cbda47a8524c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:43.321775 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0bca2ed4-48d1-4a92-a17e-cbda47a8524c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:43.322760 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0bca2ed4-48d1-4a92-a17e-cbda47a8524c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:43.324643 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0bca2ed4-48d1-4a92-a17e-cbda47a8524c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:43.325339 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0bca2ed4-48d1-4a92-a17e-cbda47a8524c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:43.494304 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-2962179b-5ebc-4cdc-b1d9-02cf871a9670 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:43.516342 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-2962179b-5ebc-4cdc-b1d9-02cf871a9670 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1363 microversion: 2.1 time: 0.312295 Jul 07 10:26:43.517830 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 47/101] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:43 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1363 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:43.536754 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-0bca2ed4-48d1-4a92-a17e-cbda47a8524c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:43.547700 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-0bca2ed4-48d1-4a92-a17e-cbda47a8524c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.246200 Jul 07 10:26:43.548306 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 55/102] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:43 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:44.021281 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-79d97a27-1283-40d2-ac86-9971eb952460 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b88596c0-71dd-4466-b594-0ec46d5e48fc"}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:26:44.023314 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-79d97a27-1283-40d2-ac86-9971eb952460 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:44.029976 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-79d97a27-1283-40d2-ac86-9971eb952460 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:44.030628 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-79d97a27-1283-40d2-ac86-9971eb952460 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:44.031912 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-79d97a27-1283-40d2-ac86-9971eb952460 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:44.032870 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-79d97a27-1283-40d2-ac86-9971eb952460 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:44.533933 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-d5f3d5d6-3a83-41b5-abd8-b5a78b66d530 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:44.534580 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-d5f3d5d6-3a83-41b5-abd8-b5a78b66d530 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:44.541127 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d5f3d5d6-3a83-41b5-abd8-b5a78b66d530 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:44.542114 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d5f3d5d6-3a83-41b5-abd8-b5a78b66d530 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:44.542893 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d5f3d5d6-3a83-41b5-abd8-b5a78b66d530 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:44.543483 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d5f3d5d6-3a83-41b5-abd8-b5a78b66d530 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:44.703380 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-d5f3d5d6-3a83-41b5-abd8-b5a78b66d530 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:44.711381 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-d5f3d5d6-3a83-41b5-abd8-b5a78b66d530 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1549 microversion: 2.1 time: 0.181374 Jul 07 10:26:44.712176 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 56/103] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:44 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1549 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:26:44.717201 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-788cc9c7-de75-46a7-88a8-d4219752a030 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:44.717787 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-788cc9c7-de75-46a7-88a8-d4219752a030 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:44.724221 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-788cc9c7-de75-46a7-88a8-d4219752a030 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:44.724667 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-788cc9c7-de75-46a7-88a8-d4219752a030 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:44.725439 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-788cc9c7-de75-46a7-88a8-d4219752a030 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:44.725872 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-788cc9c7-de75-46a7-88a8-d4219752a030 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:44.877974 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-788cc9c7-de75-46a7-88a8-d4219752a030 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:44.885470 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-788cc9c7-de75-46a7-88a8-d4219752a030 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.172342 Jul 07 10:26:44.886034 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 57/104] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:44 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:44.890712 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-cf5ecb6e-e449-42a0-8c18-32f84016ff90 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:44.891200 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-cf5ecb6e-e449-42a0-8c18-32f84016ff90 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:44.896894 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-cf5ecb6e-e449-42a0-8c18-32f84016ff90 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:44.897343 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-cf5ecb6e-e449-42a0-8c18-32f84016ff90 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:44.898097 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-cf5ecb6e-e449-42a0-8c18-32f84016ff90 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:44.898530 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-cf5ecb6e-e449-42a0-8c18-32f84016ff90 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:45.002039 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-cf5ecb6e-e449-42a0-8c18-32f84016ff90 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114903 Jul 07 10:26:45.003970 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 58/105] 10.222.0.16 () {58 vars in 1274 bytes} [Thu Jul 7 10:26:44 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:26:45.007730 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-1de2d040-88fb-4cd8-ba30-cca21e4bb0e6 req-4f330984-002c-4631-8a6c-57bbe0d80c6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a1d0d51-844a-4a45-9f11-71081578d56f", "name": "network-vif-plugged", "status": "completed", "tag": "78fdfce4-3284-497c-b70f-045463371669"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:26:45.016873 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-1de2d040-88fb-4cd8-ba30-cca21e4bb0e6 req-4f330984-002c-4631-8a6c-57bbe0d80c6b service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:45.017389 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-1de2d040-88fb-4cd8-ba30-cca21e4bb0e6 req-4f330984-002c-4631-8a6c-57bbe0d80c6b service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:45.029295 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-1de2d040-88fb-4cd8-ba30-cca21e4bb0e6 req-4f330984-002c-4631-8a6c-57bbe0d80c6b service nova] Creating event network-vif-plugged:78fdfce4-3284-497c-b70f-045463371669 for instance 1a1d0d51-844a-4a45-9f11-71081578d56f on hv-cinder-82282 Jul 07 10:26:45.034405 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-1de2d040-88fb-4cd8-ba30-cca21e4bb0e6 req-4f330984-002c-4631-8a6c-57bbe0d80c6b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030647 Jul 07 10:26:45.034992 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 59/106] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:26:45.902956 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-2cfc8223-6644-48dc-ac09-f4bf4e6119f7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:45.904842 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-2cfc8223-6644-48dc-ac09-f4bf4e6119f7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:45.911973 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2cfc8223-6644-48dc-ac09-f4bf4e6119f7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:45.912426 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2cfc8223-6644-48dc-ac09-f4bf4e6119f7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:45.913183 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2cfc8223-6644-48dc-ac09-f4bf4e6119f7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:45.913782 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2cfc8223-6644-48dc-ac09-f4bf4e6119f7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:46.137499 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-2cfc8223-6644-48dc-ac09-f4bf4e6119f7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:46.145763 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-2cfc8223-6644-48dc-ac09-f4bf4e6119f7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.247053 Jul 07 10:26:46.152949 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 60/107] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:45 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:46.464402 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-196aa263-63e0-426b-9fe5-facbb48e1aea req-4487d3b8-4ca9-49b7-99ec-ff6e67ab3be5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b00a3c72-669b-41e2-a9b9-1a2921bcabe0", "tag": "ab69b298-c3d4-4702-89eb-78fe3392b9f5"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:26:46.472595 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-196aa263-63e0-426b-9fe5-facbb48e1aea req-4487d3b8-4ca9-49b7-99ec-ff6e67ab3be5 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:46.473051 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-196aa263-63e0-426b-9fe5-facbb48e1aea req-4487d3b8-4ca9-49b7-99ec-ff6e67ab3be5 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:46.485880 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-196aa263-63e0-426b-9fe5-facbb48e1aea req-4487d3b8-4ca9-49b7-99ec-ff6e67ab3be5 service nova] Creating event network-changed:ab69b298-c3d4-4702-89eb-78fe3392b9f5 for instance b00a3c72-669b-41e2-a9b9-1a2921bcabe0 on hv-cinder-82282 Jul 07 10:26:46.491735 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-196aa263-63e0-426b-9fe5-facbb48e1aea req-4487d3b8-4ca9-49b7-99ec-ff6e67ab3be5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032300 Jul 07 10:26:46.492360 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 61/108] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 10:26:46.806964 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-79d97a27-1283-40d2-ac86-9971eb952460 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "POST /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.789820 Jul 07 10:26:46.809240 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 48/109] 10.222.0.16 () {60 vars in 1322 bytes} [Thu Jul 7 10:26:44 2022] POST /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11/os-volume_attachments => generated 194 bytes in 2793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:26:47.162963 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-53020937-3618-4203-8724-43d6d6f5046b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:47.163880 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-53020937-3618-4203-8724-43d6d6f5046b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:47.170593 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-53020937-3618-4203-8724-43d6d6f5046b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:47.171051 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-53020937-3618-4203-8724-43d6d6f5046b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:47.171848 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-53020937-3618-4203-8724-43d6d6f5046b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:47.172289 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-53020937-3618-4203-8724-43d6d6f5046b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:47.308279 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-53020937-3618-4203-8724-43d6d6f5046b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:47.315879 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-53020937-3618-4203-8724-43d6d6f5046b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.157080 Jul 07 10:26:47.316541 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 62/110] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:47 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:48.334507 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-98d3ca15-902d-45b1-b0ef-1cab7b6f8cb7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:48.335267 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-98d3ca15-902d-45b1-b0ef-1cab7b6f8cb7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:48.341620 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-98d3ca15-902d-45b1-b0ef-1cab7b6f8cb7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:48.342075 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-98d3ca15-902d-45b1-b0ef-1cab7b6f8cb7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:48.342849 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-98d3ca15-902d-45b1-b0ef-1cab7b6f8cb7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:48.343287 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-98d3ca15-902d-45b1-b0ef-1cab7b6f8cb7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:48.470415 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-98d3ca15-902d-45b1-b0ef-1cab7b6f8cb7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:48.477900 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-98d3ca15-902d-45b1-b0ef-1cab7b6f8cb7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.148188 Jul 07 10:26:48.478469 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 49/111] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:48 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:49.494521 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-cff19095-7678-42d2-be84-370d6aa95365 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:49.495114 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-cff19095-7678-42d2-be84-370d6aa95365 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:49.501051 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-cff19095-7678-42d2-be84-370d6aa95365 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:49.501508 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-cff19095-7678-42d2-be84-370d6aa95365 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:49.502295 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-cff19095-7678-42d2-be84-370d6aa95365 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:49.502728 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-cff19095-7678-42d2-be84-370d6aa95365 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:49.638685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-cff19095-7678-42d2-be84-370d6aa95365 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:49.646425 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-cff19095-7678-42d2-be84-370d6aa95365 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.155726 Jul 07 10:26:49.646991 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 63/112] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:49 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:50.663107 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-981c103f-32a7-41e1-a159-522ed0ff6df5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:50.663662 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-981c103f-32a7-41e1-a159-522ed0ff6df5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:50.670739 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-981c103f-32a7-41e1-a159-522ed0ff6df5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:50.671191 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-981c103f-32a7-41e1-a159-522ed0ff6df5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:50.671979 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-981c103f-32a7-41e1-a159-522ed0ff6df5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:50.672419 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-981c103f-32a7-41e1-a159-522ed0ff6df5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:50.894397 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-981c103f-32a7-41e1-a159-522ed0ff6df5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:50.902814 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-981c103f-32a7-41e1-a159-522ed0ff6df5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.243585 Jul 07 10:26:50.903596 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 50/113] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:50 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:51.920278 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-4880c00d-0275-4e27-a9b5-7d9badffa229 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:51.920884 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-4880c00d-0275-4e27-a9b5-7d9badffa229 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:51.927033 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4880c00d-0275-4e27-a9b5-7d9badffa229 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:51.927483 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4880c00d-0275-4e27-a9b5-7d9badffa229 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:51.928398 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4880c00d-0275-4e27-a9b5-7d9badffa229 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:51.928867 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4880c00d-0275-4e27-a9b5-7d9badffa229 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:52.076629 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-4880c00d-0275-4e27-a9b5-7d9badffa229 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:52.084180 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-4880c00d-0275-4e27-a9b5-7d9badffa229 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.168313 Jul 07 10:26:52.084746 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 64/114] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:51 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:53.101038 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c6e19523-e5c5-4d9a-9cff-e00e43defc6e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:53.101871 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c6e19523-e5c5-4d9a-9cff-e00e43defc6e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:53.108356 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c6e19523-e5c5-4d9a-9cff-e00e43defc6e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:53.108817 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c6e19523-e5c5-4d9a-9cff-e00e43defc6e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:53.109591 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c6e19523-e5c5-4d9a-9cff-e00e43defc6e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:53.110037 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c6e19523-e5c5-4d9a-9cff-e00e43defc6e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:53.249446 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c6e19523-e5c5-4d9a-9cff-e00e43defc6e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:53.256997 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c6e19523-e5c5-4d9a-9cff-e00e43defc6e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.159823 Jul 07 10:26:53.257564 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 51/115] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:53 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:54.273249 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-e74052cb-46cd-45f2-8a93-8ac92d15e6d7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:54.273859 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-e74052cb-46cd-45f2-8a93-8ac92d15e6d7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:54.280465 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e74052cb-46cd-45f2-8a93-8ac92d15e6d7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:54.280914 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e74052cb-46cd-45f2-8a93-8ac92d15e6d7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:54.281674 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e74052cb-46cd-45f2-8a93-8ac92d15e6d7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:54.282109 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e74052cb-46cd-45f2-8a93-8ac92d15e6d7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:54.408806 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-e74052cb-46cd-45f2-8a93-8ac92d15e6d7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:54.412307 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:26:54.417640 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-e74052cb-46cd-45f2-8a93-8ac92d15e6d7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.148150 Jul 07 10:26:54.418202 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 65/116] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:54 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:55.434862 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-39337803-4f1c-4d77-aee1-5eba1c34c4fe tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:55.435373 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-39337803-4f1c-4d77-aee1-5eba1c34c4fe tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:55.441853 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-39337803-4f1c-4d77-aee1-5eba1c34c4fe tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:55.442307 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-39337803-4f1c-4d77-aee1-5eba1c34c4fe tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:55.443071 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-39337803-4f1c-4d77-aee1-5eba1c34c4fe tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:55.443513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-39337803-4f1c-4d77-aee1-5eba1c34c4fe tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:55.662315 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-39337803-4f1c-4d77-aee1-5eba1c34c4fe tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:55.670584 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-39337803-4f1c-4d77-aee1-5eba1c34c4fe tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.240137 Jul 07 10:26:55.671173 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 52/117] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:55 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:56.686912 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-3c4dd859-6f80-445a-9acc-99b74230a638 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:56.687511 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-3c4dd859-6f80-445a-9acc-99b74230a638 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:56.696088 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3c4dd859-6f80-445a-9acc-99b74230a638 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:56.696698 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3c4dd859-6f80-445a-9acc-99b74230a638 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:56.698316 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3c4dd859-6f80-445a-9acc-99b74230a638 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:56.698761 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3c4dd859-6f80-445a-9acc-99b74230a638 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:56.835356 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-3c4dd859-6f80-445a-9acc-99b74230a638 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:56.843418 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-3c4dd859-6f80-445a-9acc-99b74230a638 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.160348 Jul 07 10:26:56.844230 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 66/118] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:56 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:57.863023 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-3603efed-96cb-4cd0-9dd8-8cb504c2fa1c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:57.863800 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-3603efed-96cb-4cd0-9dd8-8cb504c2fa1c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:57.871645 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3603efed-96cb-4cd0-9dd8-8cb504c2fa1c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:57.872185 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3603efed-96cb-4cd0-9dd8-8cb504c2fa1c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:57.873027 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3603efed-96cb-4cd0-9dd8-8cb504c2fa1c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:57.873534 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3603efed-96cb-4cd0-9dd8-8cb504c2fa1c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:58.024324 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-3603efed-96cb-4cd0-9dd8-8cb504c2fa1c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:58.033320 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-3603efed-96cb-4cd0-9dd8-8cb504c2fa1c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.175443 Jul 07 10:26:58.034136 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 53/119] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:57 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:59.052363 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-c54d61c2-47c6-4bdd-9074-4616322b691c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:59.053708 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-c54d61c2-47c6-4bdd-9074-4616322b691c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:59.060645 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c54d61c2-47c6-4bdd-9074-4616322b691c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:59.061161 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c54d61c2-47c6-4bdd-9074-4616322b691c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:59.061995 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c54d61c2-47c6-4bdd-9074-4616322b691c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:59.062455 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c54d61c2-47c6-4bdd-9074-4616322b691c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:59.216749 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-c54d61c2-47c6-4bdd-9074-4616322b691c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:59.236726 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-c54d61c2-47c6-4bdd-9074-4616322b691c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.190125 Jul 07 10:26:59.237651 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 67/120] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:59 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:26:59.636254 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-efdb753a-8b84-46ab-9876-f74a53a48e44 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:59.636757 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-efdb753a-8b84-46ab-9876-f74a53a48e44 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:59.639317 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=49 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:26:59.645128 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-efdb753a-8b84-46ab-9876-f74a53a48e44 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:59.645673 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-efdb753a-8b84-46ab-9876-f74a53a48e44 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:59.646532 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-efdb753a-8b84-46ab-9876-f74a53a48e44 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:59.646978 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-efdb753a-8b84-46ab-9876-f74a53a48e44 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:59.672405 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-efdb753a-8b84-46ab-9876-f74a53a48e44 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Going to try to terminate instance {{(pid=117647) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 10:26:59.770095 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-efdb753a-8b84-46ab-9876-f74a53a48e44 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 204 len: 0 microversion: 2.1 time: 0.138047 Jul 07 10:26:59.770721 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 54/121] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jul 7 10:26:59 2022] DELETE /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 10:26:59.779151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-15dc3040-8eca-4f45-8a41-bcff34ded5bc tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:26:59.779849 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-15dc3040-8eca-4f45-8a41-bcff34ded5bc tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:26:59.781652 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_api:SELECT=68 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:26:59.787049 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-15dc3040-8eca-4f45-8a41-bcff34ded5bc tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:59.787501 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-15dc3040-8eca-4f45-8a41-bcff34ded5bc tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:59.788289 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-15dc3040-8eca-4f45-8a41-bcff34ded5bc tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:26:59.788938 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-15dc3040-8eca-4f45-8a41-bcff34ded5bc tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:26:59.934648 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-15dc3040-8eca-4f45-8a41-bcff34ded5bc tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730e7d9b92c84bd5872bc0e221b616cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c765bc215964bce8a321b4f3d085ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:26:59.942950 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-15dc3040-8eca-4f45-8a41-bcff34ded5bc tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 200 len: 1554 microversion: 2.1 time: 0.167857 Jul 07 10:26:59.943525 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 68/122] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:26:59 2022] GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:27:00.254676 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-66758911-0e46-4b19-a6b9-814240d319d7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:00.256015 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-66758911-0e46-4b19-a6b9-814240d319d7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:00.263019 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-66758911-0e46-4b19-a6b9-814240d319d7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:00.263503 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-66758911-0e46-4b19-a6b9-814240d319d7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:00.264345 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-66758911-0e46-4b19-a6b9-814240d319d7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:00.264958 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-66758911-0e46-4b19-a6b9-814240d319d7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:00.405800 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-66758911-0e46-4b19-a6b9-814240d319d7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:00.413586 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-66758911-0e46-4b19-a6b9-814240d319d7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.163321 Jul 07 10:27:00.414168 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 55/123] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:00 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:27:00.960278 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-bc136508-d575-4d18-8243-287e26d559de tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:00.960894 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-bc136508-d575-4d18-8243-287e26d559de tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:00.968059 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bc136508-d575-4d18-8243-287e26d559de tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:00.968523 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bc136508-d575-4d18-8243-287e26d559de tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:00.969302 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bc136508-d575-4d18-8243-287e26d559de tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:00.969741 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bc136508-d575-4d18-8243-287e26d559de tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:01.112254 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-bc136508-d575-4d18-8243-287e26d559de tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730e7d9b92c84bd5872bc0e221b616cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c765bc215964bce8a321b4f3d085ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:01.122536 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-bc136508-d575-4d18-8243-287e26d559de tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 200 len: 1554 microversion: 2.1 time: 0.164995 Jul 07 10:27:01.134622 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 69/124] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:00 2022] GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:01.431413 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-7defcaeb-c8b8-4afa-b796-47840cf37c44 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:01.432593 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-7defcaeb-c8b8-4afa-b796-47840cf37c44 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:01.439859 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7defcaeb-c8b8-4afa-b796-47840cf37c44 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:01.439953 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7defcaeb-c8b8-4afa-b796-47840cf37c44 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:01.440785 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7defcaeb-c8b8-4afa-b796-47840cf37c44 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:01.441355 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7defcaeb-c8b8-4afa-b796-47840cf37c44 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:01.594984 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-7defcaeb-c8b8-4afa-b796-47840cf37c44 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:01.602575 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-7defcaeb-c8b8-4afa-b796-47840cf37c44 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.175797 Jul 07 10:27:01.603137 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 56/125] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:01 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:02.147495 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-dea823b1-a140-43be-a92b-5ac0eda501f8 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:02.148296 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-dea823b1-a140-43be-a92b-5ac0eda501f8 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:02.160680 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-dea823b1-a140-43be-a92b-5ac0eda501f8 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:02.161145 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-dea823b1-a140-43be-a92b-5ac0eda501f8 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:02.163533 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-dea823b1-a140-43be-a92b-5ac0eda501f8 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:02.164052 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-dea823b1-a140-43be-a92b-5ac0eda501f8 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:02.309152 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-dea823b1-a140-43be-a92b-5ac0eda501f8 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730e7d9b92c84bd5872bc0e221b616cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c765bc215964bce8a321b4f3d085ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:02.317620 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-dea823b1-a140-43be-a92b-5ac0eda501f8 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 200 len: 1554 microversion: 2.1 time: 0.174541 Jul 07 10:27:02.318131 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 70/126] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:02 2022] GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:02.620753 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-f667e77c-f71e-461a-b01b-81af9184b138 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:02.621457 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-f667e77c-f71e-461a-b01b-81af9184b138 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:02.628193 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f667e77c-f71e-461a-b01b-81af9184b138 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:02.628643 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f667e77c-f71e-461a-b01b-81af9184b138 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:02.629415 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f667e77c-f71e-461a-b01b-81af9184b138 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:02.629878 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f667e77c-f71e-461a-b01b-81af9184b138 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:02.923721 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f667e77c-f71e-461a-b01b-81af9184b138 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:02.932171 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-f667e77c-f71e-461a-b01b-81af9184b138 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.315494 Jul 07 10:27:02.932789 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 57/127] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:02 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:03.141182 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-c18ff3f5-7abb-4140-a26f-2846d6c0d937 req-49edf665-3a3f-4e64-935b-0592fb621d65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11", "name": "network-vif-deleted", "tag": "4af65680-4c8a-4420-938b-02b9403f177e"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:27:03.161216 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-c18ff3f5-7abb-4140-a26f-2846d6c0d937 req-49edf665-3a3f-4e64-935b-0592fb621d65 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:03.161844 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-c18ff3f5-7abb-4140-a26f-2846d6c0d937 req-49edf665-3a3f-4e64-935b-0592fb621d65 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:03.190422 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-c18ff3f5-7abb-4140-a26f-2846d6c0d937 req-49edf665-3a3f-4e64-935b-0592fb621d65 service nova] Creating event network-vif-deleted:4af65680-4c8a-4420-938b-02b9403f177e for instance 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 on hv-cinder-82282 Jul 07 10:27:03.197999 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-c18ff3f5-7abb-4140-a26f-2846d6c0d937 req-49edf665-3a3f-4e64-935b-0592fb621d65 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071958 Jul 07 10:27:03.199400 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 71/128] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:27:03.335363 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6bde2300-f171-4f32-956a-684aa8c223c6 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:03.336107 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6bde2300-f171-4f32-956a-684aa8c223c6 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:03.342989 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6bde2300-f171-4f32-956a-684aa8c223c6 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:03.343926 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6bde2300-f171-4f32-956a-684aa8c223c6 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:03.344909 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6bde2300-f171-4f32-956a-684aa8c223c6 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:03.345716 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6bde2300-f171-4f32-956a-684aa8c223c6 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:03.406008 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:27:03.468142 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6bde2300-f171-4f32-956a-684aa8c223c6 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730e7d9b92c84bd5872bc0e221b616cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c765bc215964bce8a321b4f3d085ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:03.477586 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6bde2300-f171-4f32-956a-684aa8c223c6 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 200 len: 1346 microversion: 2.1 time: 0.146919 Jul 07 10:27:03.478158 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 58/129] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:03 2022] GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 1346 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:03.949901 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-5e6c9166-37a5-472b-86f5-1a5d9a44f184 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:03.950724 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-5e6c9166-37a5-472b-86f5-1a5d9a44f184 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:03.957788 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5e6c9166-37a5-472b-86f5-1a5d9a44f184 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:03.958320 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5e6c9166-37a5-472b-86f5-1a5d9a44f184 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:03.959144 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5e6c9166-37a5-472b-86f5-1a5d9a44f184 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:03.959645 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5e6c9166-37a5-472b-86f5-1a5d9a44f184 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:04.135935 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-5e6c9166-37a5-472b-86f5-1a5d9a44f184 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:04.145337 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-5e6c9166-37a5-472b-86f5-1a5d9a44f184 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.200234 Jul 07 10:27:04.146434 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 72/130] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:03 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:04.494453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-937f18e5-a8ac-4119-8ba9-76f11920c67c tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:04.495074 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-937f18e5-a8ac-4119-8ba9-76f11920c67c tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:04.501836 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-937f18e5-a8ac-4119-8ba9-76f11920c67c tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:04.502285 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-937f18e5-a8ac-4119-8ba9-76f11920c67c tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:04.503086 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-937f18e5-a8ac-4119-8ba9-76f11920c67c tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:04.503696 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-937f18e5-a8ac-4119-8ba9-76f11920c67c tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:04.520106 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-937f18e5-a8ac-4119-8ba9-76f11920c67c tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] HTTP exception thrown: Instance 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 could not be found. Jul 07 10:27:04.527933 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-937f18e5-a8ac-4119-8ba9-76f11920c67c tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Request method failure captured: Jul 07 10:27:04.527933 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 HTTP/1.1 Jul 07 10:27:04.527933 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept: application/json Jul 07 10:27:04.527933 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jul 07 10:27:04.527933 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Connection: close Jul 07 10:27:04.527933 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jul 07 10:27:04.527933 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jul 07 10:27:04.527933 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Host: 10.222.0.16 Jul 07 10:27:04.527933 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jul 07 10:27:04.527933 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jul 07 10:27:04.527933 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABixrS8Eb1HsSUStLL6Vzz-HYLZIN1b02XS8soghAKknRaBq9SOqc-CUA0Xys2kCsvB-9cWO79U63XwF3i5lTVP6roPUO22BbCd6qSEg6I1fZ0OHbsxN3K5oHeFMaJhmHATWhg_lWvqD8F5da5xzlyhGZ8XXsa-DxuyNFs4kFfQxESIjFo Jul 07 10:27:04.527933 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jul 07 10:27:04.527933 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jul 07 10:27:04.527933 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jul 07 10:27:04.527933 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jul 07 10:27:04.527933 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jul 07 10:27:04.527933 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jul 07 10:27:04.527933 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Id: 0c765bc215964bce8a321b4f3d085ae6 Jul 07 10:27:04.527933 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-DeleteServersTestJSON-619227737 Jul 07 10:27:04.527933 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jul 07 10:27:04.527933 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jul 07 10:27:04.529417 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0c765bc215964bce8a321b4f3d085ae6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0c765bc215964bce8a321b4f3d085ae6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0c765bc215964bce8a321b4f3d085ae6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0c765bc215964bce8a321b4f3d085ae6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:27:04.529417 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-DeleteServersTestJSON-619227737 Jul 07 10:27:04.529417 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 0c765bc215964bce8a321b4f3d085ae6 Jul 07 10:27:04.529417 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-DeleteServersTestJSON-619227737 Jul 07 10:27:04.529417 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User: tempest-DeleteServersTestJSON-619227737-project Jul 07 10:27:04.529417 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jul 07 10:27:04.529417 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jul 07 10:27:04.529417 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Id: 730e7d9b92c84bd5872bc0e221b616cf Jul 07 10:27:04.529417 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-DeleteServersTestJSON-619227737-project Jul 07 10:27:04.529417 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: method: > Jul 07 10:27:04.529417 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: exception: Instance 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 could not be found. Jul 07 10:27:04.529417 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: action_args: {'id': '3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11'} Jul 07 10:27:04.530266 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:27:04.530266 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:27:04.530266 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:27:04.530266 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:27:04.530266 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:27:04.530266 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:27:04.530266 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:27:04.530266 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:27:04.530266 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:27:04.530266 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:27:04.530266 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 could not be found. Jul 07 10:27:04.530266 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:27:04.530266 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:27:04.530266 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:27:04.530266 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:27:04.530266 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:27:04.530266 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:27:04.530266 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:27:04.530266 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:27:04.530266 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:27:04.531660 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:27:04.531660 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:27:04.531660 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:27:04.531660 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:27:04.531660 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:27:04.531660 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:27:04.531660 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:27:04.531660 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 could not be found. Jul 07 10:27:04.531660 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:27:04.531660 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:27:04.531660 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:27:04.531660 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:27:04.531660 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:27:04.531660 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:27:04.531660 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:27:04.531660 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:27:04.531660 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 could not be found. Jul 07 10:27:04.531660 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:27:04.532885 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-937f18e5-a8ac-4119-8ba9-76f11920c67c tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Returning 404 to user: Instance 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:27:04.532885 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-937f18e5-a8ac-4119-8ba9-76f11920c67c tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 404 len: 111 microversion: 2.1 time: 0.038862 Jul 07 10:27:04.532885 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 59/131] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:04 2022] GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 07 10:27:04.647636 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-b18dd42b-f98c-48c6-a1bb-dea82f22cd28 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:04.648636 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-b18dd42b-f98c-48c6-a1bb-dea82f22cd28 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:04.656011 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b18dd42b-f98c-48c6-a1bb-dea82f22cd28 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:04.656609 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b18dd42b-f98c-48c6-a1bb-dea82f22cd28 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:04.657527 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b18dd42b-f98c-48c6-a1bb-dea82f22cd28 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:04.658125 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b18dd42b-f98c-48c6-a1bb-dea82f22cd28 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:04.673999 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.wsgi [None req-b18dd42b-f98c-48c6-a1bb-dea82f22cd28 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] HTTP exception thrown: Instance 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 could not be found. Jul 07 10:27:04.678052 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-b18dd42b-f98c-48c6-a1bb-dea82f22cd28 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Request method failure captured: Jul 07 10:27:04.678052 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11/os-volume_attachments HTTP/1.1 Jul 07 10:27:04.678052 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:27:04.678052 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:27:04.678052 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:27:04.678052 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 0 Jul 07 10:27:04.678052 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:27:04.678052 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:27:04.678052 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:27:04.678052 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:27:04.678052 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrS8Eb1HsSUStLL6Vzz-HYLZIN1b02XS8soghAKknRaBq9SOqc-CUA0Xys2kCsvB-9cWO79U63XwF3i5lTVP6roPUO22BbCd6qSEg6I1fZ0OHbsxN3K5oHeFMaJhmHATWhg_lWvqD8F5da5xzlyhGZ8XXsa-DxuyNFs4kFfQxESIjFo Jul 07 10:27:04.678052 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:27:04.678052 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:27:04.678052 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:27:04.678052 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:27:04.678052 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:27:04.678052 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:27:04.678052 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: 0c765bc215964bce8a321b4f3d085ae6 Jul 07 10:27:04.678052 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-DeleteServersTestJSON-619227737 Jul 07 10:27:04.678052 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:27:04.678052 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:27:04.679338 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0c765bc215964bce8a321b4f3d085ae6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0c765bc215964bce8a321b4f3d085ae6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0c765bc215964bce8a321b4f3d085ae6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0c765bc215964bce8a321b4f3d085ae6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:27:04.679338 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-DeleteServersTestJSON-619227737 Jul 07 10:27:04.679338 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: 0c765bc215964bce8a321b4f3d085ae6 Jul 07 10:27:04.679338 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-DeleteServersTestJSON-619227737 Jul 07 10:27:04.679338 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-DeleteServersTestJSON-619227737-project Jul 07 10:27:04.679338 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:27:04.679338 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:27:04.679338 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: 730e7d9b92c84bd5872bc0e221b616cf Jul 07 10:27:04.679338 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-DeleteServersTestJSON-619227737-project Jul 07 10:27:04.679338 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: > Jul 07 10:27:04.679338 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Instance 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 could not be found. Jul 07 10:27:04.679338 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'server_id': '3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11'} Jul 07 10:27:04.680132 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:27:04.680132 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:27:04.680132 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:27:04.680132 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:27:04.680132 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:27:04.680132 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:27:04.680132 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:27:04.680132 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:27:04.680132 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:27:04.680132 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:27:04.680132 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 could not be found. Jul 07 10:27:04.680132 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:27:04.680132 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:27:04.680132 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:27:04.680132 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:27:04.680132 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:27:04.680132 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:27:04.680132 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:27:04.680132 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:27:04.680132 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:27:04.681435 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:27:04.681435 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 07 10:27:04.681435 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 10:27:04.681435 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 07 10:27:04.681435 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 10:27:04.681435 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 07 10:27:04.681435 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 07 10:27:04.681435 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:27:04.681435 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:27:04.681435 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 could not be found. Jul 07 10:27:04.681435 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:27:04.681435 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:27:04.681435 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:27:04.681435 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:27:04.681435 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:27:04.681435 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:27:04.681435 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:27:04.681435 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:27:04.681435 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 could not be found. Jul 07 10:27:04.681435 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:27:04.682616 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-b18dd42b-f98c-48c6-a1bb-dea82f22cd28 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Returning 404 to user: Instance 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 could not be found. {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:27:04.682616 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-b18dd42b-f98c-48c6-a1bb-dea82f22cd28 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035818 Jul 07 10:27:04.683242 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 73/132] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jul 7 10:27:04 2022] GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:27:05.162772 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d059e747-c813-4532-91c8-dc6b7dc5a6ef tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:05.163586 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d059e747-c813-4532-91c8-dc6b7dc5a6ef tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:05.169786 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d059e747-c813-4532-91c8-dc6b7dc5a6ef tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:05.170475 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d059e747-c813-4532-91c8-dc6b7dc5a6ef tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:05.171614 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d059e747-c813-4532-91c8-dc6b7dc5a6ef tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:05.172274 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d059e747-c813-4532-91c8-dc6b7dc5a6ef tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:05.372410 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d059e747-c813-4532-91c8-dc6b7dc5a6ef tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:05.382609 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d059e747-c813-4532-91c8-dc6b7dc5a6ef tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.224025 Jul 07 10:27:05.386687 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 60/133] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:05 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:05.894646 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-aac09d30-b808-44db-b71b-68323fc10c6f tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:05.896013 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-aac09d30-b808-44db-b71b-68323fc10c6f tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:05.904852 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-aac09d30-b808-44db-b71b-68323fc10c6f tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:05.906018 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-aac09d30-b808-44db-b71b-68323fc10c6f tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:05.907621 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-aac09d30-b808-44db-b71b-68323fc10c6f tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:05.908429 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-aac09d30-b808-44db-b71b-68323fc10c6f tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:05.934171 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.wsgi [None req-aac09d30-b808-44db-b71b-68323fc10c6f tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] HTTP exception thrown: Instance 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 could not be found. Jul 07 10:27:05.937197 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-aac09d30-b808-44db-b71b-68323fc10c6f tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Request method failure captured: Jul 07 10:27:05.937197 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: DELETE /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 HTTP/1.1 Jul 07 10:27:05.937197 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:27:05.937197 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:27:05.937197 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:27:05.937197 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 0 Jul 07 10:27:05.937197 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:27:05.937197 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:27:05.937197 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:27:05.937197 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:27:05.937197 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrS8Eb1HsSUStLL6Vzz-HYLZIN1b02XS8soghAKknRaBq9SOqc-CUA0Xys2kCsvB-9cWO79U63XwF3i5lTVP6roPUO22BbCd6qSEg6I1fZ0OHbsxN3K5oHeFMaJhmHATWhg_lWvqD8F5da5xzlyhGZ8XXsa-DxuyNFs4kFfQxESIjFo Jul 07 10:27:05.937197 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:27:05.937197 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:27:05.937197 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:27:05.937197 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:27:05.937197 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:27:05.937197 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:27:05.937197 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: 0c765bc215964bce8a321b4f3d085ae6 Jul 07 10:27:05.937197 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-DeleteServersTestJSON-619227737 Jul 07 10:27:05.937197 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:27:05.937197 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:27:05.938641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0c765bc215964bce8a321b4f3d085ae6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0c765bc215964bce8a321b4f3d085ae6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0c765bc215964bce8a321b4f3d085ae6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0c765bc215964bce8a321b4f3d085ae6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:27:05.938641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-DeleteServersTestJSON-619227737 Jul 07 10:27:05.938641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: 0c765bc215964bce8a321b4f3d085ae6 Jul 07 10:27:05.938641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-DeleteServersTestJSON-619227737 Jul 07 10:27:05.938641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-DeleteServersTestJSON-619227737-project Jul 07 10:27:05.938641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:27:05.938641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:27:05.938641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: 730e7d9b92c84bd5872bc0e221b616cf Jul 07 10:27:05.938641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-DeleteServersTestJSON-619227737-project Jul 07 10:27:05.938641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: > Jul 07 10:27:05.938641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Instance 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 could not be found. Jul 07 10:27:05.938641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'id': '3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11'} Jul 07 10:27:05.939269 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:27:05.939269 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:27:05.939269 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:27:05.939269 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:27:05.939269 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:27:05.939269 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:27:05.939269 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:27:05.939269 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:27:05.939269 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:27:05.939269 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:27:05.939269 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 could not be found. Jul 07 10:27:05.939269 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:27:05.939269 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:27:05.939269 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:27:05.939269 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:27:05.939269 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:27:05.939269 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:27:05.939269 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:27:05.939269 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:27:05.939269 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:27:05.940811 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:27:05.940811 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 10:27:05.940811 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 10:27:05.940811 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 10:27:05.940811 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 10:27:05.940811 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:27:05.940811 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:27:05.940811 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:27:05.940811 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:27:05.940811 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 could not be found. Jul 07 10:27:05.940811 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:27:05.940811 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:27:05.940811 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:27:05.940811 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:27:05.940811 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:27:05.940811 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:27:05.940811 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:27:05.940811 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:27:05.940811 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 could not be found. Jul 07 10:27:05.940811 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:27:05.943535 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-aac09d30-b808-44db-b71b-68323fc10c6f tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Returning 404 to user: Instance 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 could not be found. {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:27:05.949041 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-aac09d30-b808-44db-b71b-68323fc10c6f tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 404 len: 111 microversion: 2.1 time: 0.058567 Jul 07 10:27:05.950251 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 74/134] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jul 7 10:27:05 2022] DELETE /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:27:05.958606 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c0a9095c-bcb7-4b02-9705-b66b6ba36d18 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:05.960067 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c0a9095c-bcb7-4b02-9705-b66b6ba36d18 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] [instance: 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:05.969065 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c0a9095c-bcb7-4b02-9705-b66b6ba36d18 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:05.969700 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c0a9095c-bcb7-4b02-9705-b66b6ba36d18 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:05.970976 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c0a9095c-bcb7-4b02-9705-b66b6ba36d18 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:05.971884 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c0a9095c-bcb7-4b02-9705-b66b6ba36d18 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:05.989247 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-c0a9095c-bcb7-4b02-9705-b66b6ba36d18 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] HTTP exception thrown: Instance 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 could not be found. Jul 07 10:27:05.990862 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c0a9095c-bcb7-4b02-9705-b66b6ba36d18 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Request method failure captured: Jul 07 10:27:05.990862 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 HTTP/1.1 Jul 07 10:27:05.990862 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept: application/json Jul 07 10:27:05.990862 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jul 07 10:27:05.990862 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Connection: close Jul 07 10:27:05.990862 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jul 07 10:27:05.990862 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jul 07 10:27:05.990862 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Host: 10.222.0.16 Jul 07 10:27:05.990862 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jul 07 10:27:05.990862 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jul 07 10:27:05.990862 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABixrS8Eb1HsSUStLL6Vzz-HYLZIN1b02XS8soghAKknRaBq9SOqc-CUA0Xys2kCsvB-9cWO79U63XwF3i5lTVP6roPUO22BbCd6qSEg6I1fZ0OHbsxN3K5oHeFMaJhmHATWhg_lWvqD8F5da5xzlyhGZ8XXsa-DxuyNFs4kFfQxESIjFo Jul 07 10:27:05.990862 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jul 07 10:27:05.990862 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jul 07 10:27:05.990862 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jul 07 10:27:05.990862 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jul 07 10:27:05.990862 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jul 07 10:27:05.990862 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jul 07 10:27:05.990862 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Id: 0c765bc215964bce8a321b4f3d085ae6 Jul 07 10:27:05.990862 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-DeleteServersTestJSON-619227737 Jul 07 10:27:05.990862 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jul 07 10:27:05.990862 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jul 07 10:27:05.992015 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0c765bc215964bce8a321b4f3d085ae6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0c765bc215964bce8a321b4f3d085ae6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0c765bc215964bce8a321b4f3d085ae6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0c765bc215964bce8a321b4f3d085ae6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:27:05.992015 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-DeleteServersTestJSON-619227737 Jul 07 10:27:05.992015 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 0c765bc215964bce8a321b4f3d085ae6 Jul 07 10:27:05.992015 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-DeleteServersTestJSON-619227737 Jul 07 10:27:05.992015 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User: tempest-DeleteServersTestJSON-619227737-project Jul 07 10:27:05.992015 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jul 07 10:27:05.992015 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jul 07 10:27:05.992015 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Id: 730e7d9b92c84bd5872bc0e221b616cf Jul 07 10:27:05.992015 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-DeleteServersTestJSON-619227737-project Jul 07 10:27:05.992015 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: method: > Jul 07 10:27:05.992015 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: exception: Instance 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 could not be found. Jul 07 10:27:05.992015 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: action_args: {'id': '3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11'} Jul 07 10:27:05.992673 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:27:05.992673 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:27:05.992673 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:27:05.992673 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:27:05.992673 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:27:05.992673 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:27:05.992673 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:27:05.992673 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:27:05.992673 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:27:05.992673 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:27:05.992673 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 could not be found. Jul 07 10:27:05.992673 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:27:05.992673 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:27:05.992673 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:27:05.992673 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:27:05.992673 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:27:05.992673 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:27:05.992673 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:27:05.992673 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:27:05.992673 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:27:05.997170 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:27:05.997170 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:27:05.997170 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:27:05.997170 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:27:05.997170 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:27:05.997170 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:27:05.997170 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:27:05.997170 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 could not be found. Jul 07 10:27:05.997170 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:27:05.997170 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:27:05.997170 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:27:05.997170 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:27:05.997170 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:27:05.997170 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:27:05.997170 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:27:05.997170 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:27:05.997170 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 could not be found. Jul 07 10:27:05.997170 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:27:05.998093 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c0a9095c-bcb7-4b02-9705-b66b6ba36d18 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] Returning 404 to user: Instance 3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:27:05.998093 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c0a9095c-bcb7-4b02-9705-b66b6ba36d18 tempest-DeleteServersTestJSON-619227737 tempest-DeleteServersTestJSON-619227737-project] 10.222.0.16 "GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11" status: 404 len: 111 microversion: 2.1 time: 0.038215 Jul 07 10:27:05.998093 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 61/135] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:05 2022] GET /compute/v2.1/servers/3dd4ae0a-d36e-4e86-a8d8-b4ac5e005c11 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:27:06.414657 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-bf497d9f-c9f7-425d-944d-670ab19b560b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:06.415280 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-bf497d9f-c9f7-425d-944d-670ab19b560b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:06.427667 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bf497d9f-c9f7-425d-944d-670ab19b560b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:06.428892 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bf497d9f-c9f7-425d-944d-670ab19b560b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:06.429911 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bf497d9f-c9f7-425d-944d-670ab19b560b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:06.430631 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bf497d9f-c9f7-425d-944d-670ab19b560b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:06.729007 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-bf497d9f-c9f7-425d-944d-670ab19b560b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:06.753151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-bf497d9f-c9f7-425d-944d-670ab19b560b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.346377 Jul 07 10:27:06.754475 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 75/136] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:06 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:07.771842 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-77837747-e58a-408f-abbc-6338b34d0ff3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:07.772472 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-77837747-e58a-408f-abbc-6338b34d0ff3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:07.797491 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-77837747-e58a-408f-abbc-6338b34d0ff3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:07.798611 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-77837747-e58a-408f-abbc-6338b34d0ff3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:07.806628 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-77837747-e58a-408f-abbc-6338b34d0ff3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:07.808072 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-77837747-e58a-408f-abbc-6338b34d0ff3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:08.718642 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-77837747-e58a-408f-abbc-6338b34d0ff3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:08.726287 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-77837747-e58a-408f-abbc-6338b34d0ff3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.959172 Jul 07 10:27:08.745421 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 62/137] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:07 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:09.745674 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-fe848a81-b776-40b8-b4a9-8e48aaaf1e10 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:09.748097 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-fe848a81-b776-40b8-b4a9-8e48aaaf1e10 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:09.787813 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fe848a81-b776-40b8-b4a9-8e48aaaf1e10 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:09.791180 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fe848a81-b776-40b8-b4a9-8e48aaaf1e10 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:09.792644 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fe848a81-b776-40b8-b4a9-8e48aaaf1e10 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:09.796811 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fe848a81-b776-40b8-b4a9-8e48aaaf1e10 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:10.157309 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-fe848a81-b776-40b8-b4a9-8e48aaaf1e10 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:10.167334 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-fe848a81-b776-40b8-b4a9-8e48aaaf1e10 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.427349 Jul 07 10:27:10.171660 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 76/138] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:09 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:11.192874 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c198469c-9b56-44b1-a6a2-4db2d675e349 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:11.194890 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c198469c-9b56-44b1-a6a2-4db2d675e349 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:11.213833 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c198469c-9b56-44b1-a6a2-4db2d675e349 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:11.225436 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c198469c-9b56-44b1-a6a2-4db2d675e349 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:11.226854 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c198469c-9b56-44b1-a6a2-4db2d675e349 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:11.229637 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c198469c-9b56-44b1-a6a2-4db2d675e349 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:11.583729 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c198469c-9b56-44b1-a6a2-4db2d675e349 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:11.593744 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c198469c-9b56-44b1-a6a2-4db2d675e349 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.409292 Jul 07 10:27:11.611527 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 63/139] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:11 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:12.610647 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-1ae54afc-315d-4f78-be02-4ca7b08a658e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:12.611263 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-1ae54afc-315d-4f78-be02-4ca7b08a658e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:12.621506 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1ae54afc-315d-4f78-be02-4ca7b08a658e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:12.621995 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1ae54afc-315d-4f78-be02-4ca7b08a658e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:12.622739 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1ae54afc-315d-4f78-be02-4ca7b08a658e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:12.623230 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1ae54afc-315d-4f78-be02-4ca7b08a658e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:13.077430 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-1ae54afc-315d-4f78-be02-4ca7b08a658e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:13.094847 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-1ae54afc-315d-4f78-be02-4ca7b08a658e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.487171 Jul 07 10:27:13.096587 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 77/140] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:12 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:14.115940 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8796b417-6147-47e6-9975-78b18eb843b8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:14.117129 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8796b417-6147-47e6-9975-78b18eb843b8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:14.137369 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8796b417-6147-47e6-9975-78b18eb843b8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:14.138130 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8796b417-6147-47e6-9975-78b18eb843b8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:14.141955 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8796b417-6147-47e6-9975-78b18eb843b8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:14.142756 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8796b417-6147-47e6-9975-78b18eb843b8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:14.840634 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8796b417-6147-47e6-9975-78b18eb843b8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:14.850443 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8796b417-6147-47e6-9975-78b18eb843b8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.739931 Jul 07 10:27:14.851983 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 64/141] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:14 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:15.870121 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a432f1de-6d71-4fd0-944b-4229727b40b3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:15.872281 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-a432f1de-6d71-4fd0-944b-4229727b40b3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:15.898817 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a432f1de-6d71-4fd0-944b-4229727b40b3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:15.904819 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a432f1de-6d71-4fd0-944b-4229727b40b3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:15.905778 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a432f1de-6d71-4fd0-944b-4229727b40b3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:15.909891 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a432f1de-6d71-4fd0-944b-4229727b40b3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:16.174793 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-a432f1de-6d71-4fd0-944b-4229727b40b3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:16.191063 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-a432f1de-6d71-4fd0-944b-4229727b40b3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.326012 Jul 07 10:27:16.195818 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 78/142] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:15 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:17.210801 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e50d84e1-74e4-487a-9429-3ea15d67adf3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:17.212139 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e50d84e1-74e4-487a-9429-3ea15d67adf3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:17.240269 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e50d84e1-74e4-487a-9429-3ea15d67adf3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:17.241135 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e50d84e1-74e4-487a-9429-3ea15d67adf3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:17.242515 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e50d84e1-74e4-487a-9429-3ea15d67adf3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:17.243186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e50d84e1-74e4-487a-9429-3ea15d67adf3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:17.273665 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-eac3a2ff-3818-4397-8f14-138ed82a7fc4 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-540161950", "imageRef": "1c96509d-f65f-42b0-94b3-6fc590a93508", "flavorRef": "452", "networks": [{"uuid": "077a047b-f9c7-490e-ac9f-1de351d3c473"}]}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:27:17.375057 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.network.neutron [None req-eac3a2ff-3818-4397-8f14-138ed82a7fc4 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] validate_networks() for [('077a047b-f9c7-490e-ac9f-1de351d3c473', None, None, None, None, None)] {{(pid=117646) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 10:27:17.492585 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e50d84e1-74e4-487a-9429-3ea15d67adf3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:17.505819 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e50d84e1-74e4-487a-9429-3ea15d67adf3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.300368 Jul 07 10:27:17.517570 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 65/143] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:17 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:18.118330 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-eac3a2ff-3818-4397-8f14-138ed82a7fc4 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Flavor limits 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 10:27:18.119517 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-eac3a2ff-3818-4397-8f14-138ed82a7fc4 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Image limits 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 10:27:18.120014 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-eac3a2ff-3818-4397-8f14-138ed82a7fc4 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Flavor pref 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 10:27:18.120421 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-eac3a2ff-3818-4397-8f14-138ed82a7fc4 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Image pref 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 10:27:18.120882 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-eac3a2ff-3818-4397-8f14-138ed82a7fc4 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 10:27:18.135025 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-eac3a2ff-3818-4397-8f14-138ed82a7fc4 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:18.136046 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-eac3a2ff-3818-4397-8f14-138ed82a7fc4 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:18.145939 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-eac3a2ff-3818-4397-8f14-138ed82a7fc4 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:18.146593 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-eac3a2ff-3818-4397-8f14-138ed82a7fc4 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:18.167586 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-eac3a2ff-3818-4397-8f14-138ed82a7fc4 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Getting quotas for project 3d3b58b3beed423aba9a7c28d1e09c88. Resources: {'cores', 'ram', 'instances'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:27:18.172077 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-eac3a2ff-3818-4397-8f14-138ed82a7fc4 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Getting quotas for user f28b6a7ebf8c4cbab9193b95b8de6818 and project 3d3b58b3beed423aba9a7c28d1e09c88. Resources: {'cores', 'ram', 'instances'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:27:18.184748 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-eac3a2ff-3818-4397-8f14-138ed82a7fc4 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Going to run 1 instances... {{(pid=117646) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 10:27:18.187332 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-eac3a2ff-3818-4397-8f14-138ed82a7fc4 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: 192443a1-9b3b-4838-92b6-ac0031f4c767] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c96509d-f65f-42b0-94b3-6fc590a93508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 10:27:18.253220 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-eac3a2ff-3818-4397-8f14-138ed82a7fc4 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.983613 Jul 07 10:27:18.255398 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 79/144] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jul 7 10:27:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 10:27:18.265991 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-94a284c1-7b3c-4096-87ea-8d4a6eb59ba8 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:18.266608 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-94a284c1-7b3c-4096-87ea-8d4a6eb59ba8 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: 192443a1-9b3b-4838-92b6-ac0031f4c767] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:18.383722 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-94a284c1-7b3c-4096-87ea-8d4a6eb59ba8 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:18.401174 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-94a284c1-7b3c-4096-87ea-8d4a6eb59ba8 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767" status: 200 len: 1213 microversion: 2.1 time: 0.139815 Jul 07 10:27:18.401974 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 66/145] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:18 2022] GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767 => generated 1213 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:27:18.524194 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-d48fc5e2-5077-450d-95e6-d88d2cd1c92f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:18.525531 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-d48fc5e2-5077-450d-95e6-d88d2cd1c92f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:18.540665 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d48fc5e2-5077-450d-95e6-d88d2cd1c92f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:18.541129 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d48fc5e2-5077-450d-95e6-d88d2cd1c92f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:18.552368 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d48fc5e2-5077-450d-95e6-d88d2cd1c92f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:18.553213 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d48fc5e2-5077-450d-95e6-d88d2cd1c92f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:19.230163 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-d48fc5e2-5077-450d-95e6-d88d2cd1c92f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:19.261775 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-d48fc5e2-5077-450d-95e6-d88d2cd1c92f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.722446 Jul 07 10:27:19.263896 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 80/146] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:18 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:19.419224 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-425ff834-5a51-4cbc-ab6d-63607a8f87c2 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:19.419987 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-425ff834-5a51-4cbc-ab6d-63607a8f87c2 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: 192443a1-9b3b-4838-92b6-ac0031f4c767] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:19.435771 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-425ff834-5a51-4cbc-ab6d-63607a8f87c2 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:19.436411 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-425ff834-5a51-4cbc-ab6d-63607a8f87c2 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:19.439031 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-425ff834-5a51-4cbc-ab6d-63607a8f87c2 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:19.441690 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-425ff834-5a51-4cbc-ab6d-63607a8f87c2 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:19.603850 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-425ff834-5a51-4cbc-ab6d-63607a8f87c2 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:19.624552 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-425ff834-5a51-4cbc-ab6d-63607a8f87c2 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767" status: 200 len: 1265 microversion: 2.1 time: 0.210617 Jul 07 10:27:19.626552 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 67/147] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:19 2022] GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:20.282215 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-766239c6-0b46-4886-9725-901652645579 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:20.284274 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-766239c6-0b46-4886-9725-901652645579 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:20.303219 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-766239c6-0b46-4886-9725-901652645579 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:20.305274 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-766239c6-0b46-4886-9725-901652645579 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:20.308209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-766239c6-0b46-4886-9725-901652645579 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:20.311317 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-766239c6-0b46-4886-9725-901652645579 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:20.612686 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-766239c6-0b46-4886-9725-901652645579 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:20.626222 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-766239c6-0b46-4886-9725-901652645579 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.348821 Jul 07 10:27:20.630191 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 81/148] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:20 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:20.652621 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8a7925ee-4771-49e6-8a9f-05dfb4560740 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:20.654058 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8a7925ee-4771-49e6-8a9f-05dfb4560740 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: 192443a1-9b3b-4838-92b6-ac0031f4c767] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:20.660921 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8a7925ee-4771-49e6-8a9f-05dfb4560740 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:20.661721 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8a7925ee-4771-49e6-8a9f-05dfb4560740 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:20.662685 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8a7925ee-4771-49e6-8a9f-05dfb4560740 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:20.663194 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8a7925ee-4771-49e6-8a9f-05dfb4560740 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:20.845600 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8a7925ee-4771-49e6-8a9f-05dfb4560740 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:20.856585 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8a7925ee-4771-49e6-8a9f-05dfb4560740 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767" status: 200 len: 1271 microversion: 2.1 time: 0.210137 Jul 07 10:27:20.861872 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 68/149] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:20 2022] GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767 => generated 1271 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:21.647533 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-31132aaf-2da7-469b-b6bb-75c8a3b3fbdb tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:21.648364 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-31132aaf-2da7-469b-b6bb-75c8a3b3fbdb tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:21.661820 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-31132aaf-2da7-469b-b6bb-75c8a3b3fbdb tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:21.663901 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-31132aaf-2da7-469b-b6bb-75c8a3b3fbdb tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:21.665385 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-31132aaf-2da7-469b-b6bb-75c8a3b3fbdb tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:21.666563 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-31132aaf-2da7-469b-b6bb-75c8a3b3fbdb tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:21.878085 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-3c345e4e-d06a-4bda-b1bb-3daebe446009 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:21.880228 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-3c345e4e-d06a-4bda-b1bb-3daebe446009 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: 192443a1-9b3b-4838-92b6-ac0031f4c767] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:21.890877 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3c345e4e-d06a-4bda-b1bb-3daebe446009 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:21.900946 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3c345e4e-d06a-4bda-b1bb-3daebe446009 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:21.900946 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3c345e4e-d06a-4bda-b1bb-3daebe446009 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:21.901411 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3c345e4e-d06a-4bda-b1bb-3daebe446009 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:22.010711 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-31132aaf-2da7-469b-b6bb-75c8a3b3fbdb tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:22.020689 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-31132aaf-2da7-469b-b6bb-75c8a3b3fbdb tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.378052 Jul 07 10:27:22.021737 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 82/150] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:21 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:22.180943 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-3c345e4e-d06a-4bda-b1bb-3daebe446009 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:22.189932 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-3c345e4e-d06a-4bda-b1bb-3daebe446009 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767" status: 200 len: 1313 microversion: 2.1 time: 0.315594 Jul 07 10:27:22.192677 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 69/151] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:21 2022] GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767 => generated 1313 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:27:23.052780 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-27c4a922-2f4d-46f6-a5d0-5189bc479138 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:23.054167 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-27c4a922-2f4d-46f6-a5d0-5189bc479138 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:23.079068 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-27c4a922-2f4d-46f6-a5d0-5189bc479138 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:23.081622 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-27c4a922-2f4d-46f6-a5d0-5189bc479138 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:23.082374 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-27c4a922-2f4d-46f6-a5d0-5189bc479138 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:23.085727 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-27c4a922-2f4d-46f6-a5d0-5189bc479138 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:23.207474 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e162481e-6b3e-4f59-880e-16d7974d96bb tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:23.208300 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e162481e-6b3e-4f59-880e-16d7974d96bb tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: 192443a1-9b3b-4838-92b6-ac0031f4c767] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:23.216794 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e162481e-6b3e-4f59-880e-16d7974d96bb tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:23.217246 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e162481e-6b3e-4f59-880e-16d7974d96bb tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:23.218211 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e162481e-6b3e-4f59-880e-16d7974d96bb tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:23.218651 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e162481e-6b3e-4f59-880e-16d7974d96bb tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:23.500564 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-27c4a922-2f4d-46f6-a5d0-5189bc479138 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:23.517764 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-27c4a922-2f4d-46f6-a5d0-5189bc479138 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.480941 Jul 07 10:27:23.519871 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 83/152] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:23 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:23.981251 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e162481e-6b3e-4f59-880e-16d7974d96bb tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:23.996257 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e162481e-6b3e-4f59-880e-16d7974d96bb tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767" status: 200 len: 1313 microversion: 2.1 time: 0.785805 Jul 07 10:27:24.003218 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 70/153] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:23 2022] GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767 => generated 1313 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:27:24.517465 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-cff2bb21-732c-4a7e-9a0e-8480b925dee1 req-082b3a2d-4888-4041-a5cd-65b60b263f18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "192443a1-9b3b-4838-92b6-ac0031f4c767", "tag": "fa036119-0380-421c-bdbb-88402fea7f30"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:27:24.529986 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-cff2bb21-732c-4a7e-9a0e-8480b925dee1 req-082b3a2d-4888-4041-a5cd-65b60b263f18 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:24.530757 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-cff2bb21-732c-4a7e-9a0e-8480b925dee1 req-082b3a2d-4888-4041-a5cd-65b60b263f18 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:24.534705 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ad35858b-ec9c-450a-a0e7-45eaa9f56cf9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:24.536031 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ad35858b-ec9c-450a-a0e7-45eaa9f56cf9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:24.547013 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-cff2bb21-732c-4a7e-9a0e-8480b925dee1 req-082b3a2d-4888-4041-a5cd-65b60b263f18 service nova] Creating event network-changed:fa036119-0380-421c-bdbb-88402fea7f30 for instance 192443a1-9b3b-4838-92b6-ac0031f4c767 on hv-cinder-82282 Jul 07 10:27:24.547260 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ad35858b-ec9c-450a-a0e7-45eaa9f56cf9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:24.547516 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ad35858b-ec9c-450a-a0e7-45eaa9f56cf9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:24.548343 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ad35858b-ec9c-450a-a0e7-45eaa9f56cf9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:24.548792 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ad35858b-ec9c-450a-a0e7-45eaa9f56cf9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:24.554554 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-cff2bb21-732c-4a7e-9a0e-8480b925dee1 req-082b3a2d-4888-4041-a5cd-65b60b263f18 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041356 Jul 07 10:27:24.560151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 84/154] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:27:24.963813 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ad35858b-ec9c-450a-a0e7-45eaa9f56cf9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:24.974348 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ad35858b-ec9c-450a-a0e7-45eaa9f56cf9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.443362 Jul 07 10:27:24.975100 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 71/155] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:24 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:27:25.020260 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-4836b25d-73e4-400e-94e0-3d9529fa3c96 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:25.020955 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-4836b25d-73e4-400e-94e0-3d9529fa3c96 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: 192443a1-9b3b-4838-92b6-ac0031f4c767] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:25.046466 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4836b25d-73e4-400e-94e0-3d9529fa3c96 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:25.047264 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4836b25d-73e4-400e-94e0-3d9529fa3c96 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:25.048249 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4836b25d-73e4-400e-94e0-3d9529fa3c96 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:25.048846 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4836b25d-73e4-400e-94e0-3d9529fa3c96 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:25.364756 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-4836b25d-73e4-400e-94e0-3d9529fa3c96 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:25.370768 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=100 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:27:25.383390 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-4836b25d-73e4-400e-94e0-3d9529fa3c96 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767" status: 200 len: 1313 microversion: 2.1 time: 0.368615 Jul 07 10:27:25.386965 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 85/156] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:25 2022] GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767 => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:25.991096 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-871571e2-6ffa-40b0-b06b-ee068550866c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:25.992380 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-871571e2-6ffa-40b0-b06b-ee068550866c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:26.001996 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-871571e2-6ffa-40b0-b06b-ee068550866c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:26.010499 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-871571e2-6ffa-40b0-b06b-ee068550866c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:26.011331 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-871571e2-6ffa-40b0-b06b-ee068550866c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:26.011794 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-871571e2-6ffa-40b0-b06b-ee068550866c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:26.403933 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-da73be67-bcde-4385-b155-320106dea381 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:26.405121 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-da73be67-bcde-4385-b155-320106dea381 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: 192443a1-9b3b-4838-92b6-ac0031f4c767] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:26.422480 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-da73be67-bcde-4385-b155-320106dea381 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:26.423373 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-da73be67-bcde-4385-b155-320106dea381 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:26.443248 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-da73be67-bcde-4385-b155-320106dea381 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:26.444490 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-da73be67-bcde-4385-b155-320106dea381 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:26.680147 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-da73be67-bcde-4385-b155-320106dea381 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:26.687622 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-da73be67-bcde-4385-b155-320106dea381 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767" status: 200 len: 1313 microversion: 2.1 time: 0.288777 Jul 07 10:27:26.699169 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 86/157] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:26 2022] GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767 => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:27:26.724115 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-871571e2-6ffa-40b0-b06b-ee068550866c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:26.740277 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-871571e2-6ffa-40b0-b06b-ee068550866c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.747254 Jul 07 10:27:26.741528 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 72/158] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:25 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:27.719991 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-b7d3af2a-ef0c-49d7-93f6-8ae397f88848 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:27.723012 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-b7d3af2a-ef0c-49d7-93f6-8ae397f88848 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: 192443a1-9b3b-4838-92b6-ac0031f4c767] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:27.736650 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b7d3af2a-ef0c-49d7-93f6-8ae397f88848 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:27.737888 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b7d3af2a-ef0c-49d7-93f6-8ae397f88848 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:27.739696 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b7d3af2a-ef0c-49d7-93f6-8ae397f88848 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:27.740861 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b7d3af2a-ef0c-49d7-93f6-8ae397f88848 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:27.766258 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-aab39fd9-858e-41bb-a878-2ad06afb94ba tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:27.767547 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-aab39fd9-858e-41bb-a878-2ad06afb94ba tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:27.794239 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-aab39fd9-858e-41bb-a878-2ad06afb94ba tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:27.794720 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-aab39fd9-858e-41bb-a878-2ad06afb94ba tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:27.797119 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-aab39fd9-858e-41bb-a878-2ad06afb94ba tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:27.797777 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-aab39fd9-858e-41bb-a878-2ad06afb94ba tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:27.933471 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-b7d3af2a-ef0c-49d7-93f6-8ae397f88848 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:27.954087 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-b7d3af2a-ef0c-49d7-93f6-8ae397f88848 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767" status: 200 len: 1313 microversion: 2.1 time: 0.246442 Jul 07 10:27:27.967886 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 87/159] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:27 2022] GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767 => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:28.242450 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-aab39fd9-858e-41bb-a878-2ad06afb94ba tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:28.251164 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-aab39fd9-858e-41bb-a878-2ad06afb94ba tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.493585 Jul 07 10:27:28.251769 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 73/160] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:27 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:28.971050 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-94c9b7dd-d8c9-4bcf-8b25-411bbe8e08ad tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:28.972346 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-94c9b7dd-d8c9-4bcf-8b25-411bbe8e08ad tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: 192443a1-9b3b-4838-92b6-ac0031f4c767] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:28.974579 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell0:SELECT=2 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:27:28.975649 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell0:SELECT=6 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:27:28.992619 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-94c9b7dd-d8c9-4bcf-8b25-411bbe8e08ad tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:28.993872 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-94c9b7dd-d8c9-4bcf-8b25-411bbe8e08ad tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:28.994803 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-94c9b7dd-d8c9-4bcf-8b25-411bbe8e08ad tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:28.995390 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-94c9b7dd-d8c9-4bcf-8b25-411bbe8e08ad tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:29.194455 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-94c9b7dd-d8c9-4bcf-8b25-411bbe8e08ad tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:29.211216 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-94c9b7dd-d8c9-4bcf-8b25-411bbe8e08ad tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767" status: 200 len: 1313 microversion: 2.1 time: 0.236579 Jul 07 10:27:29.211216 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 88/161] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:28 2022] GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:29.268542 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6d162698-357d-4fc2-b88b-08574557f15e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:29.269423 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6d162698-357d-4fc2-b88b-08574557f15e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:29.271627 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:27:29.280130 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6d162698-357d-4fc2-b88b-08574557f15e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:29.281955 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6d162698-357d-4fc2-b88b-08574557f15e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:29.282951 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6d162698-357d-4fc2-b88b-08574557f15e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:29.283704 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6d162698-357d-4fc2-b88b-08574557f15e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:29.471414 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6d162698-357d-4fc2-b88b-08574557f15e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:29.484901 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6d162698-357d-4fc2-b88b-08574557f15e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.220297 Jul 07 10:27:29.490752 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 74/162] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:29 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:30.221611 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-391f6e47-8eb4-40e5-a2c4-71367e8ab02c tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:30.222245 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-391f6e47-8eb4-40e5-a2c4-71367e8ab02c tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: 192443a1-9b3b-4838-92b6-ac0031f4c767] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:30.224212 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:27:30.236385 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-391f6e47-8eb4-40e5-a2c4-71367e8ab02c tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:30.236847 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-391f6e47-8eb4-40e5-a2c4-71367e8ab02c tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:30.237627 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-391f6e47-8eb4-40e5-a2c4-71367e8ab02c tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:30.238066 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-391f6e47-8eb4-40e5-a2c4-71367e8ab02c tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:30.400913 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-391f6e47-8eb4-40e5-a2c4-71367e8ab02c tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:30.409637 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-391f6e47-8eb4-40e5-a2c4-71367e8ab02c tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767" status: 200 len: 1313 microversion: 2.1 time: 0.191791 Jul 07 10:27:30.411371 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 89/163] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:30 2022] GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:30.505239 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8e43808a-bb61-4ceb-954e-09aaaeb4d35c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:30.506590 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8e43808a-bb61-4ceb-954e-09aaaeb4d35c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:30.513819 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:27:30.518662 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8e43808a-bb61-4ceb-954e-09aaaeb4d35c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:30.519463 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8e43808a-bb61-4ceb-954e-09aaaeb4d35c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:30.521013 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8e43808a-bb61-4ceb-954e-09aaaeb4d35c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:30.521677 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8e43808a-bb61-4ceb-954e-09aaaeb4d35c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:30.695661 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8e43808a-bb61-4ceb-954e-09aaaeb4d35c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:30.706227 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8e43808a-bb61-4ceb-954e-09aaaeb4d35c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.204981 Jul 07 10:27:30.707135 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 75/164] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:30 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:31.428255 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-6d31a657-aafb-48ad-8cd9-14b05bb49d5b tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:31.429502 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-6d31a657-aafb-48ad-8cd9-14b05bb49d5b tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: 192443a1-9b3b-4838-92b6-ac0031f4c767] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:31.442829 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6d31a657-aafb-48ad-8cd9-14b05bb49d5b tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:31.443598 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6d31a657-aafb-48ad-8cd9-14b05bb49d5b tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:31.444772 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6d31a657-aafb-48ad-8cd9-14b05bb49d5b tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:31.445478 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6d31a657-aafb-48ad-8cd9-14b05bb49d5b tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:31.660471 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-6d31a657-aafb-48ad-8cd9-14b05bb49d5b tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:31.669275 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-6d31a657-aafb-48ad-8cd9-14b05bb49d5b tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767" status: 200 len: 1313 microversion: 2.1 time: 0.245143 Jul 07 10:27:31.670567 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 90/165] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:31 2022] GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767 => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:31.726083 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9fbe95be-3d82-4f1f-aed9-d489148608c0 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:31.727294 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-9fbe95be-3d82-4f1f-aed9-d489148608c0 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:31.746058 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9fbe95be-3d82-4f1f-aed9-d489148608c0 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:31.747223 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9fbe95be-3d82-4f1f-aed9-d489148608c0 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:31.748108 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9fbe95be-3d82-4f1f-aed9-d489148608c0 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:31.748808 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9fbe95be-3d82-4f1f-aed9-d489148608c0 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:31.927791 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9fbe95be-3d82-4f1f-aed9-d489148608c0 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:31.937669 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9fbe95be-3d82-4f1f-aed9-d489148608c0 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1522 microversion: 2.1 time: 0.217625 Jul 07 10:27:31.948957 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 76/166] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:31 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:32.688534 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-f2859746-cc37-4f23-908e-887c69a3d68d tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:32.689166 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-f2859746-cc37-4f23-908e-887c69a3d68d tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: 192443a1-9b3b-4838-92b6-ac0031f4c767] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:32.706097 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f2859746-cc37-4f23-908e-887c69a3d68d tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:32.706820 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f2859746-cc37-4f23-908e-887c69a3d68d tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:32.707616 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f2859746-cc37-4f23-908e-887c69a3d68d tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:32.708095 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f2859746-cc37-4f23-908e-887c69a3d68d tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:32.879701 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-f2859746-cc37-4f23-908e-887c69a3d68d tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:32.888407 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-f2859746-cc37-4f23-908e-887c69a3d68d tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767" status: 200 len: 1313 microversion: 2.1 time: 0.205268 Jul 07 10:27:32.889085 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 91/167] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:32 2022] GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:32.958012 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-309634f6-9b4d-43a4-b3a0-1d9380cb52ca tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:32.959370 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-309634f6-9b4d-43a4-b3a0-1d9380cb52ca tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:32.966814 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-309634f6-9b4d-43a4-b3a0-1d9380cb52ca tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:32.967312 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-309634f6-9b4d-43a4-b3a0-1d9380cb52ca tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:32.968108 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-309634f6-9b4d-43a4-b3a0-1d9380cb52ca tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:32.968707 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-309634f6-9b4d-43a4-b3a0-1d9380cb52ca tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:32.995394 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=100 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:27:33.115906 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-309634f6-9b4d-43a4-b3a0-1d9380cb52ca tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:33.124509 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-309634f6-9b4d-43a4-b3a0-1d9380cb52ca tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1502 microversion: 2.1 time: 0.171844 Jul 07 10:27:33.125259 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 77/168] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:32 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1502 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:33.140909 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-2025f521-d973-484e-b0f7-05e0016781d7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:33.141537 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-2025f521-d973-484e-b0f7-05e0016781d7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:33.147676 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2025f521-d973-484e-b0f7-05e0016781d7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:33.148369 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2025f521-d973-484e-b0f7-05e0016781d7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:33.149292 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2025f521-d973-484e-b0f7-05e0016781d7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:33.149911 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2025f521-d973-484e-b0f7-05e0016781d7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:33.298030 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-2025f521-d973-484e-b0f7-05e0016781d7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:33.306797 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-2025f521-d973-484e-b0f7-05e0016781d7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f" status: 200 len: 1516 microversion: 2.1 time: 0.170224 Jul 07 10:27:33.307949 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 92/169] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:33 2022] GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:33.906347 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b7313f56-af43-4351-b10f-4d563396973e tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:33.907510 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b7313f56-af43-4351-b10f-4d563396973e tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: 192443a1-9b3b-4838-92b6-ac0031f4c767] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:33.913941 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b7313f56-af43-4351-b10f-4d563396973e tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:33.914386 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b7313f56-af43-4351-b10f-4d563396973e tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:33.915282 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b7313f56-af43-4351-b10f-4d563396973e tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:33.915855 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b7313f56-af43-4351-b10f-4d563396973e tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:34.069873 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b7313f56-af43-4351-b10f-4d563396973e tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:34.082434 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b7313f56-af43-4351-b10f-4d563396973e tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767" status: 200 len: 1313 microversion: 2.1 time: 0.180227 Jul 07 10:27:34.083135 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 78/170] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:33 2022] GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:34.780573 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-72026360-b9ff-4e70-b2b5-77ed1c62e1e0 req-85584624-f642-4feb-a95f-41688ef4e86d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "192443a1-9b3b-4838-92b6-ac0031f4c767", "name": "network-vif-plugged", "status": "completed", "tag": "fa036119-0380-421c-bdbb-88402fea7f30"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:27:34.791015 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-72026360-b9ff-4e70-b2b5-77ed1c62e1e0 req-85584624-f642-4feb-a95f-41688ef4e86d service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:34.792166 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-72026360-b9ff-4e70-b2b5-77ed1c62e1e0 req-85584624-f642-4feb-a95f-41688ef4e86d service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:34.810148 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2501ac85-cf91-443a-8725-8a6bd37491f9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:27:34.811573 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-2501ac85-cf91-443a-8725-8a6bd37491f9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:34.824337 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2501ac85-cf91-443a-8725-8a6bd37491f9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:34.824939 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2501ac85-cf91-443a-8725-8a6bd37491f9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:34.825967 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2501ac85-cf91-443a-8725-8a6bd37491f9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:34.826521 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2501ac85-cf91-443a-8725-8a6bd37491f9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:34.830816 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-72026360-b9ff-4e70-b2b5-77ed1c62e1e0 req-85584624-f642-4feb-a95f-41688ef4e86d service nova] Creating event network-vif-plugged:fa036119-0380-421c-bdbb-88402fea7f30 for instance 192443a1-9b3b-4838-92b6-ac0031f4c767 on hv-cinder-82282 Jul 07 10:27:34.840784 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-72026360-b9ff-4e70-b2b5-77ed1c62e1e0 req-85584624-f642-4feb-a95f-41688ef4e86d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064275 Jul 07 10:27:34.841835 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 93/171] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:27:34.870184 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.objects.instance [None req-2501ac85-cf91-443a-8725-8a6bd37491f9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lazy-loading 'flavor' on Instance uuid 1a1d0d51-844a-4a45-9f11-71081578d56f {{(pid=117647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 10:27:35.059657 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-2501ac85-cf91-443a-8725-8a6bd37491f9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "POST /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f/action" status: 200 len: 32 microversion: 2.1 time: 0.255843 Jul 07 10:27:35.060424 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 79/172] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Jul 7 10:27:34 2022] POST /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f/action => generated 32 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 10:27:35.080854 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-c733d500-7e7c-4b3c-8b64-a4182da63be7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:35.081619 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-c733d500-7e7c-4b3c-8b64-a4182da63be7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:35.083462 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b06b09a3-f25a-4843-a45c-bad7bf6eb9d5 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Action: 'create', calling method: .version_select at 0x7f9e9f11d4c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1225089622", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGb9Lj/Vc0dPRHBtro4GTxXtVNaE8SClK8mWjrdBto5niRUYIx+s33bJuzyaKf1A8CHeg5YJZpumVwE64RUencUE3lyFHjMksXLnbuysTTKVfYfOuXNF2EQjpTYhvZfUvQ=="}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:27:35.092256 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c733d500-7e7c-4b3c-8b64-a4182da63be7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:35.092707 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c733d500-7e7c-4b3c-8b64-a4182da63be7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:35.093489 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c733d500-7e7c-4b3c-8b64-a4182da63be7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:35.100251 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c733d500-7e7c-4b3c-8b64-a4182da63be7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:35.107771 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-b06b09a3-f25a-4843-a45c-bad7bf6eb9d5 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Getting quotas for project 5a2481546251413fb65aaed9e3f131e2. Resources: {'key_pairs'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:27:35.113607 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-b06b09a3-f25a-4843-a45c-bad7bf6eb9d5 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Getting quotas for user 9ae3a6ce6ab4425ebf1180721c10eb2d and project 5a2481546251413fb65aaed9e3f131e2. Resources: {'key_pairs'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:27:35.168617 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b06b09a3-f25a-4843-a45c-bad7bf6eb9d5 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.091454 Jul 07 10:27:35.169251 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 80/173] 10.222.0.16 () {60 vars in 1158 bytes} [Thu Jul 7 10:27:35 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 10:27:35.175700 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a27c77fa-a986-4f7a-a06a-a863f698bf72 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:35.177540 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a27c77fa-a986-4f7a-a06a-a863f698bf72 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: 192443a1-9b3b-4838-92b6-ac0031f4c767] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:35.188617 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a27c77fa-a986-4f7a-a06a-a863f698bf72 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:35.189280 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a27c77fa-a986-4f7a-a06a-a863f698bf72 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:35.190423 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a27c77fa-a986-4f7a-a06a-a863f698bf72 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:35.191613 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a27c77fa-a986-4f7a-a06a-a863f698bf72 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:35.277586 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-c733d500-7e7c-4b3c-8b64-a4182da63be7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:35.287526 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-c733d500-7e7c-4b3c-8b64-a4182da63be7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f" status: 200 len: 1522 microversion: 2.1 time: 0.219668 Jul 07 10:27:35.288426 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 94/174] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:35 2022] GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:35.334367 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-0ed805ab-543d-42b6-af05-3608600711ac tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2068823472", "imageRef": "c11416aa-a064-499a-9569-bb0bde9f3ac6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1225089622", "networks": [{"uuid": "1caf8388-6f56-4a8d-9a0e-d7281aa69eca"}]}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:27:35.406841 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.network.neutron [None req-0ed805ab-543d-42b6-af05-3608600711ac tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] validate_networks() for [('1caf8388-6f56-4a8d-9a0e-d7281aa69eca', None, None, None, None, None)] {{(pid=117646) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 10:27:35.467949 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a27c77fa-a986-4f7a-a06a-a863f698bf72 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:35.476329 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a27c77fa-a986-4f7a-a06a-a863f698bf72 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767" status: 200 len: 1313 microversion: 2.1 time: 0.306040 Jul 07 10:27:35.477154 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 81/175] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:35 2022] GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767 => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:35.846720 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-0ed805ab-543d-42b6-af05-3608600711ac tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Flavor limits 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 10:27:35.847479 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-0ed805ab-543d-42b6-af05-3608600711ac tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Image limits 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 10:27:35.848036 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-0ed805ab-543d-42b6-af05-3608600711ac tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Flavor pref 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 10:27:35.848442 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-0ed805ab-543d-42b6-af05-3608600711ac tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Image pref 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 10:27:35.848877 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-0ed805ab-543d-42b6-af05-3608600711ac tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 10:27:35.859625 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0ed805ab-543d-42b6-af05-3608600711ac tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:35.860200 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0ed805ab-543d-42b6-af05-3608600711ac tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:35.861190 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0ed805ab-543d-42b6-af05-3608600711ac tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:35.861875 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0ed805ab-543d-42b6-af05-3608600711ac tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:35.880324 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-0ed805ab-543d-42b6-af05-3608600711ac tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Getting quotas for project 5a2481546251413fb65aaed9e3f131e2. Resources: {'cores', 'ram', 'instances'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:27:35.885399 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-0ed805ab-543d-42b6-af05-3608600711ac tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Getting quotas for user 9ae3a6ce6ab4425ebf1180721c10eb2d and project 5a2481546251413fb65aaed9e3f131e2. Resources: {'cores', 'ram', 'instances'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:27:35.897240 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-0ed805ab-543d-42b6-af05-3608600711ac tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Going to run 1 instances... {{(pid=117646) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 10:27:35.900002 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-0ed805ab-543d-42b6-af05-3608600711ac tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c11416aa-a064-499a-9569-bb0bde9f3ac6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 10:27:35.947806 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-0ed805ab-543d-42b6-af05-3608600711ac tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.618008 Jul 07 10:27:35.948739 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 95/176] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jul 7 10:27:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 07 10:27:35.959046 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-968c2eb5-dd7e-4192-8cdc-d2c786f4a80a tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:35.959761 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-968c2eb5-dd7e-4192-8cdc-d2c786f4a80a tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:36.018474 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-968c2eb5-dd7e-4192-8cdc-d2c786f4a80a tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:36.026009 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-968c2eb5-dd7e-4192-8cdc-d2c786f4a80a tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1259 microversion: 2.1 time: 0.071294 Jul 07 10:27:36.026587 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 82/177] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:35 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1259 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:36.306778 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-af01baa2-e079-47e2-9160-75cf32c7e455 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:36.308034 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-af01baa2-e079-47e2-9160-75cf32c7e455 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:36.317450 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-af01baa2-e079-47e2-9160-75cf32c7e455 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:36.317959 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-af01baa2-e079-47e2-9160-75cf32c7e455 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:36.319119 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-af01baa2-e079-47e2-9160-75cf32c7e455 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:36.319881 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-af01baa2-e079-47e2-9160-75cf32c7e455 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:36.479830 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-af01baa2-e079-47e2-9160-75cf32c7e455 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:36.488080 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-af01baa2-e079-47e2-9160-75cf32c7e455 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f" status: 200 len: 1522 microversion: 2.1 time: 0.185722 Jul 07 10:27:36.498835 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ac8ab1cc-1efa-4a3d-b5a7-fc3ee2fca861 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:36.498835 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ac8ab1cc-1efa-4a3d-b5a7-fc3ee2fca861 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: 192443a1-9b3b-4838-92b6-ac0031f4c767] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:36.500112 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 96/178] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:36 2022] GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:36.507861 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ac8ab1cc-1efa-4a3d-b5a7-fc3ee2fca861 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:36.507861 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ac8ab1cc-1efa-4a3d-b5a7-fc3ee2fca861 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:36.507861 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ac8ab1cc-1efa-4a3d-b5a7-fc3ee2fca861 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:36.507861 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ac8ab1cc-1efa-4a3d-b5a7-fc3ee2fca861 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:36.717631 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ac8ab1cc-1efa-4a3d-b5a7-fc3ee2fca861 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:36.725532 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ac8ab1cc-1efa-4a3d-b5a7-fc3ee2fca861 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767" status: 200 len: 1313 microversion: 2.1 time: 0.234441 Jul 07 10:27:36.736082 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 83/179] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:36 2022] GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:37.062442 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-9ac26651-bab8-4ea3-b3c3-bf9d3eb4c38f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:37.065513 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-9ac26651-bab8-4ea3-b3c3-bf9d3eb4c38f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:37.085739 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9ac26651-bab8-4ea3-b3c3-bf9d3eb4c38f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:37.086545 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9ac26651-bab8-4ea3-b3c3-bf9d3eb4c38f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:37.087310 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9ac26651-bab8-4ea3-b3c3-bf9d3eb4c38f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:37.087771 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9ac26651-bab8-4ea3-b3c3-bf9d3eb4c38f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:37.190663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-9ac26651-bab8-4ea3-b3c3-bf9d3eb4c38f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:37.205207 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-9ac26651-bab8-4ea3-b3c3-bf9d3eb4c38f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1255 microversion: 2.1 time: 0.163621 Jul 07 10:27:37.208701 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 97/180] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:37 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1255 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:37.505647 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0860e48a-e44e-46c0-8748-76384701ac96 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:37.506923 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0860e48a-e44e-46c0-8748-76384701ac96 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:37.514334 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0860e48a-e44e-46c0-8748-76384701ac96 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:37.514782 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0860e48a-e44e-46c0-8748-76384701ac96 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:37.515575 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0860e48a-e44e-46c0-8748-76384701ac96 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:37.516030 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0860e48a-e44e-46c0-8748-76384701ac96 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:37.661945 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0860e48a-e44e-46c0-8748-76384701ac96 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:37.669525 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0860e48a-e44e-46c0-8748-76384701ac96 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f" status: 200 len: 1522 microversion: 2.1 time: 0.167758 Jul 07 10:27:37.670104 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 84/181] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:37 2022] GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:37.742085 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-1994d14e-075b-43fd-9a51-a5e0e3d0ef67 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:37.742704 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-1994d14e-075b-43fd-9a51-a5e0e3d0ef67 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: 192443a1-9b3b-4838-92b6-ac0031f4c767] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:37.748728 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1994d14e-075b-43fd-9a51-a5e0e3d0ef67 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:37.749183 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1994d14e-075b-43fd-9a51-a5e0e3d0ef67 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:37.749954 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1994d14e-075b-43fd-9a51-a5e0e3d0ef67 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:37.750391 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1994d14e-075b-43fd-9a51-a5e0e3d0ef67 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:37.884681 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-1994d14e-075b-43fd-9a51-a5e0e3d0ef67 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:37.892550 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-1994d14e-075b-43fd-9a51-a5e0e3d0ef67 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767" status: 200 len: 1497 microversion: 2.1 time: 0.154065 Jul 07 10:27:37.893110 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 98/182] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:37 2022] GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767 => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:38.225299 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-56b6c54d-b37a-4d1b-a260-7ffdd811785f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:38.225909 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-56b6c54d-b37a-4d1b-a260-7ffdd811785f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:38.232521 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-56b6c54d-b37a-4d1b-a260-7ffdd811785f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:38.232970 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-56b6c54d-b37a-4d1b-a260-7ffdd811785f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:38.233723 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-56b6c54d-b37a-4d1b-a260-7ffdd811785f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:38.234157 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-56b6c54d-b37a-4d1b-a260-7ffdd811785f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:38.298303 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-56b6c54d-b37a-4d1b-a260-7ffdd811785f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:38.306757 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-56b6c54d-b37a-4d1b-a260-7ffdd811785f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1311 microversion: 2.1 time: 0.085530 Jul 07 10:27:38.307322 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 85/183] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:38 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1311 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:38.686144 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-688383e2-054d-41cb-a1a5-a3b07e044232 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:38.686769 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-688383e2-054d-41cb-a1a5-a3b07e044232 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:38.692782 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-688383e2-054d-41cb-a1a5-a3b07e044232 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:38.693234 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-688383e2-054d-41cb-a1a5-a3b07e044232 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:38.693995 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-688383e2-054d-41cb-a1a5-a3b07e044232 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:38.694435 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-688383e2-054d-41cb-a1a5-a3b07e044232 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:38.819859 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-688383e2-054d-41cb-a1a5-a3b07e044232 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:38.827622 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-688383e2-054d-41cb-a1a5-a3b07e044232 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f" status: 200 len: 1522 microversion: 2.1 time: 0.145099 Jul 07 10:27:38.828184 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 99/184] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:38 2022] GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:39.324852 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-41c267b2-4898-4223-ac9e-e29917bb83ec tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:39.325472 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-41c267b2-4898-4223-ac9e-e29917bb83ec tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:39.331926 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-41c267b2-4898-4223-ac9e-e29917bb83ec tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:39.332384 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-41c267b2-4898-4223-ac9e-e29917bb83ec tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:39.333150 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-41c267b2-4898-4223-ac9e-e29917bb83ec tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:39.333589 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-41c267b2-4898-4223-ac9e-e29917bb83ec tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:39.394043 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-41c267b2-4898-4223-ac9e-e29917bb83ec tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:39.401299 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-41c267b2-4898-4223-ac9e-e29917bb83ec tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1311 microversion: 2.1 time: 0.081048 Jul 07 10:27:39.401873 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 86/185] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:39 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1311 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:39.845538 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-9ce33667-4f0e-4219-8a30-c5fb4cb33638 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:39.846147 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-9ce33667-4f0e-4219-8a30-c5fb4cb33638 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:39.852134 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9ce33667-4f0e-4219-8a30-c5fb4cb33638 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:39.852585 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9ce33667-4f0e-4219-8a30-c5fb4cb33638 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:39.853339 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9ce33667-4f0e-4219-8a30-c5fb4cb33638 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:39.853775 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9ce33667-4f0e-4219-8a30-c5fb4cb33638 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:39.976906 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-9ce33667-4f0e-4219-8a30-c5fb4cb33638 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:39.984247 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-9ce33667-4f0e-4219-8a30-c5fb4cb33638 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f" status: 200 len: 1522 microversion: 2.1 time: 0.142540 Jul 07 10:27:39.984811 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 100/186] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:39 2022] GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:40.419445 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2b7762e7-136b-4fb2-a574-585d298c9eea tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:40.420249 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-2b7762e7-136b-4fb2-a574-585d298c9eea tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:40.427321 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2b7762e7-136b-4fb2-a574-585d298c9eea tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:40.428426 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2b7762e7-136b-4fb2-a574-585d298c9eea tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:40.428547 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2b7762e7-136b-4fb2-a574-585d298c9eea tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:40.428987 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2b7762e7-136b-4fb2-a574-585d298c9eea tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:40.505776 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-2b7762e7-136b-4fb2-a574-585d298c9eea tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:40.513820 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-2b7762e7-136b-4fb2-a574-585d298c9eea tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1317 microversion: 2.1 time: 0.098703 Jul 07 10:27:40.514901 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 87/187] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:40 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1317 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:40.758270 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-937de179-92d5-4aac-ab3b-b57d4a19ef6a tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:40.758877 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-937de179-92d5-4aac-ab3b-b57d4a19ef6a tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: 192443a1-9b3b-4838-92b6-ac0031f4c767] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:40.781133 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-937de179-92d5-4aac-ab3b-b57d4a19ef6a tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:40.791477 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-937de179-92d5-4aac-ab3b-b57d4a19ef6a tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:40.792841 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-937de179-92d5-4aac-ab3b-b57d4a19ef6a tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:40.793445 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-937de179-92d5-4aac-ab3b-b57d4a19ef6a tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:40.823664 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-937de179-92d5-4aac-ab3b-b57d4a19ef6a tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: 192443a1-9b3b-4838-92b6-ac0031f4c767] Going to try to terminate instance {{(pid=117646) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 10:27:40.956825 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-937de179-92d5-4aac-ab3b-b57d4a19ef6a tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "DELETE /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767" status: 204 len: 0 microversion: 2.1 time: 0.201301 Jul 07 10:27:40.959688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 101/188] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jul 7 10:27:40 2022] DELETE /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 10:27:40.968853 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-7c4d7a8f-3f84-4ac4-9f26-e451560a9611 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:40.975901 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-7c4d7a8f-3f84-4ac4-9f26-e451560a9611 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: 192443a1-9b3b-4838-92b6-ac0031f4c767] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:40.983269 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7c4d7a8f-3f84-4ac4-9f26-e451560a9611 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:40.983841 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7c4d7a8f-3f84-4ac4-9f26-e451560a9611 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:40.985339 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7c4d7a8f-3f84-4ac4-9f26-e451560a9611 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:40.986091 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7c4d7a8f-3f84-4ac4-9f26-e451560a9611 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:41.002782 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-eb0e536b-a14d-4ded-95b7-d49dcf0aa1dd tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:41.003966 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-eb0e536b-a14d-4ded-95b7-d49dcf0aa1dd tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:41.017526 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-eb0e536b-a14d-4ded-95b7-d49dcf0aa1dd tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:41.019114 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-eb0e536b-a14d-4ded-95b7-d49dcf0aa1dd tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:41.025077 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-eb0e536b-a14d-4ded-95b7-d49dcf0aa1dd tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:41.025598 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-eb0e536b-a14d-4ded-95b7-d49dcf0aa1dd tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:41.055687 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:27:41.173401 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-7c4d7a8f-3f84-4ac4-9f26-e451560a9611 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:41.181705 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-7c4d7a8f-3f84-4ac4-9f26-e451560a9611 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767" status: 200 len: 1503 microversion: 2.1 time: 0.217928 Jul 07 10:27:41.186879 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 88/189] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:40 2022] GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767 => generated 1503 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:41.218923 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-eb0e536b-a14d-4ded-95b7-d49dcf0aa1dd tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:41.226794 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-eb0e536b-a14d-4ded-95b7-d49dcf0aa1dd tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f" status: 200 len: 1522 microversion: 2.1 time: 0.228773 Jul 07 10:27:41.228061 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 102/190] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:40 2022] GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:27:41.322298 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-3d096811-a5cd-4bb6-8a8b-559829bc5770 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-944493941", "imageRef": "1c96509d-f65f-42b0-94b3-6fc590a93508", "flavorRef": "452"}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:27:41.375737 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.network.neutron [None req-3d096811-a5cd-4bb6-8a8b-559829bc5770 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] validate_networks() for None {{(pid=117647) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 10:27:41.530975 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-05692cee-8084-48de-81da-9a232b90a324 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:41.531816 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-05692cee-8084-48de-81da-9a232b90a324 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:41.538913 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-05692cee-8084-48de-81da-9a232b90a324 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:41.539572 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-05692cee-8084-48de-81da-9a232b90a324 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:41.540686 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-05692cee-8084-48de-81da-9a232b90a324 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:41.541381 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-05692cee-8084-48de-81da-9a232b90a324 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:41.664757 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-3d096811-a5cd-4bb6-8a8b-559829bc5770 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Flavor limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 10:27:41.665282 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-3d096811-a5cd-4bb6-8a8b-559829bc5770 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Image limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 10:27:41.665658 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-3d096811-a5cd-4bb6-8a8b-559829bc5770 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Flavor pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 10:27:41.666057 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-3d096811-a5cd-4bb6-8a8b-559829bc5770 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Image pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 10:27:41.666477 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-3d096811-a5cd-4bb6-8a8b-559829bc5770 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 10:27:41.675924 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3d096811-a5cd-4bb6-8a8b-559829bc5770 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:41.676085 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-05692cee-8084-48de-81da-9a232b90a324 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:41.676400 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3d096811-a5cd-4bb6-8a8b-559829bc5770 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:41.677177 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3d096811-a5cd-4bb6-8a8b-559829bc5770 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:41.677617 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3d096811-a5cd-4bb6-8a8b-559829bc5770 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:41.684099 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-05692cee-8084-48de-81da-9a232b90a324 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1359 microversion: 2.1 time: 0.157006 Jul 07 10:27:41.684663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 103/191] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:41 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:27:41.695490 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-3d096811-a5cd-4bb6-8a8b-559829bc5770 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Getting quotas for project 71b2e4cb235e41da9ade19672bdd2e4d. Resources: {'cores', 'ram', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:27:41.700296 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-3d096811-a5cd-4bb6-8a8b-559829bc5770 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Getting quotas for user ee9bcb3226f240a5951ab9971f6bb654 and project 71b2e4cb235e41da9ade19672bdd2e4d. Resources: {'cores', 'ram', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:27:41.711635 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-3d096811-a5cd-4bb6-8a8b-559829bc5770 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Going to run 1 instances... {{(pid=117647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 10:27:41.714092 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-3d096811-a5cd-4bb6-8a8b-559829bc5770 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] [instance: 03a8b2e2-624f-44b3-81fb-f7bf6d23634e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c96509d-f65f-42b0-94b3-6fc590a93508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 10:27:41.759195 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-3d096811-a5cd-4bb6-8a8b-559829bc5770 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.441422 Jul 07 10:27:41.759806 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 89/192] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jul 7 10:27:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 10:27:41.769860 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-81a76f92-7263-47e4-ab03-578ae992212c tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:41.770467 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-81a76f92-7263-47e4-ab03-578ae992212c tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] [instance: 03a8b2e2-624f-44b3-81fb-f7bf6d23634e] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:41.839994 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-81a76f92-7263-47e4-ab03-578ae992212c tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9bcb3226f240a5951ab9971f6bb654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b2e4cb235e41da9ade19672bdd2e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:41.846534 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-81a76f92-7263-47e4-ab03-578ae992212c tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] 10.222.0.16 "GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e" status: 200 len: 1214 microversion: 2.1 time: 0.080604 Jul 07 10:27:41.847921 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 104/193] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:41 2022] GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:42.198794 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e416f209-924d-4f77-b79c-7c5bfe82c5c1 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:42.199763 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e416f209-924d-4f77-b79c-7c5bfe82c5c1 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: 192443a1-9b3b-4838-92b6-ac0031f4c767] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:42.207110 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e416f209-924d-4f77-b79c-7c5bfe82c5c1 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:42.207635 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e416f209-924d-4f77-b79c-7c5bfe82c5c1 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:42.208499 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e416f209-924d-4f77-b79c-7c5bfe82c5c1 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:42.209004 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e416f209-924d-4f77-b79c-7c5bfe82c5c1 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:42.244580 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-d4b525e9-e2cf-47f1-a1cc-df1efedbb12b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:42.246453 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-d4b525e9-e2cf-47f1-a1cc-df1efedbb12b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:42.258969 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d4b525e9-e2cf-47f1-a1cc-df1efedbb12b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:42.259769 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d4b525e9-e2cf-47f1-a1cc-df1efedbb12b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:42.260742 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d4b525e9-e2cf-47f1-a1cc-df1efedbb12b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:42.261372 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d4b525e9-e2cf-47f1-a1cc-df1efedbb12b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:42.462869 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e416f209-924d-4f77-b79c-7c5bfe82c5c1 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:42.472758 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e416f209-924d-4f77-b79c-7c5bfe82c5c1 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767" status: 200 len: 1503 microversion: 2.1 time: 0.278128 Jul 07 10:27:42.473511 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 90/194] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:42 2022] GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767 => generated 1503 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:42.526592 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-d4b525e9-e2cf-47f1-a1cc-df1efedbb12b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:42.545155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-d4b525e9-e2cf-47f1-a1cc-df1efedbb12b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f" status: 200 len: 1522 microversion: 2.1 time: 0.305119 Jul 07 10:27:42.546196 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 105/195] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:42 2022] GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:27:42.704273 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-3cc80ac0-7165-49fa-b45e-5792f9ae2873 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:42.706275 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-3cc80ac0-7165-49fa-b45e-5792f9ae2873 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:42.731075 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3cc80ac0-7165-49fa-b45e-5792f9ae2873 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:42.732652 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3cc80ac0-7165-49fa-b45e-5792f9ae2873 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:42.734254 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3cc80ac0-7165-49fa-b45e-5792f9ae2873 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:42.735936 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3cc80ac0-7165-49fa-b45e-5792f9ae2873 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:42.865121 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-b0451c0a-e7fd-4959-8b4a-552bb6359746 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:42.865737 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-b0451c0a-e7fd-4959-8b4a-552bb6359746 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] [instance: 03a8b2e2-624f-44b3-81fb-f7bf6d23634e] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:42.875074 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b0451c0a-e7fd-4959-8b4a-552bb6359746 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:42.875933 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b0451c0a-e7fd-4959-8b4a-552bb6359746 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:42.877161 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b0451c0a-e7fd-4959-8b4a-552bb6359746 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:42.878007 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b0451c0a-e7fd-4959-8b4a-552bb6359746 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:42.988250 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-b0451c0a-e7fd-4959-8b4a-552bb6359746 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9bcb3226f240a5951ab9971f6bb654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b2e4cb235e41da9ade19672bdd2e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:43.017147 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-b0451c0a-e7fd-4959-8b4a-552bb6359746 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] 10.222.0.16 "GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e" status: 200 len: 1218 microversion: 2.1 time: 0.156857 Jul 07 10:27:43.018889 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 106/196] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:42 2022] GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e => generated 1218 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:43.044486 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-3cc80ac0-7165-49fa-b45e-5792f9ae2873 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:43.056048 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-3cc80ac0-7165-49fa-b45e-5792f9ae2873 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1359 microversion: 2.1 time: 0.355271 Jul 07 10:27:43.058732 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 91/197] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:42 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1359 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:43.491013 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-f6d35bf0-3446-434e-b186-224d802afe6f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:43.491622 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-f6d35bf0-3446-434e-b186-224d802afe6f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: 192443a1-9b3b-4838-92b6-ac0031f4c767] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:43.498286 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f6d35bf0-3446-434e-b186-224d802afe6f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:43.498742 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f6d35bf0-3446-434e-b186-224d802afe6f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:43.499512 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f6d35bf0-3446-434e-b186-224d802afe6f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:43.499981 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f6d35bf0-3446-434e-b186-224d802afe6f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:43.563501 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8085903c-037f-4777-8d00-a59b3fcf3049 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:43.564135 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8085903c-037f-4777-8d00-a59b3fcf3049 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:43.580533 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8085903c-037f-4777-8d00-a59b3fcf3049 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:43.581503 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8085903c-037f-4777-8d00-a59b3fcf3049 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:43.583839 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8085903c-037f-4777-8d00-a59b3fcf3049 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:43.584514 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8085903c-037f-4777-8d00-a59b3fcf3049 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:43.686984 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-f6d35bf0-3446-434e-b186-224d802afe6f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:43.697982 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-f6d35bf0-3446-434e-b186-224d802afe6f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767" status: 200 len: 1503 microversion: 2.1 time: 0.211351 Jul 07 10:27:43.698710 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 107/198] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:43 2022] GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767 => generated 1503 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:43.930252 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8085903c-037f-4777-8d00-a59b3fcf3049 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:43.942284 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8085903c-037f-4777-8d00-a59b3fcf3049 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f" status: 200 len: 1522 microversion: 2.1 time: 0.382693 Jul 07 10:27:43.946196 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 92/199] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:43 2022] GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f => generated 1522 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:27:44.035932 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-8b91fb0b-4201-418d-ba43-5dbd3b2c6261 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:44.036892 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-8b91fb0b-4201-418d-ba43-5dbd3b2c6261 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] [instance: 03a8b2e2-624f-44b3-81fb-f7bf6d23634e] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:44.049663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8b91fb0b-4201-418d-ba43-5dbd3b2c6261 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:44.053829 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8b91fb0b-4201-418d-ba43-5dbd3b2c6261 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:44.055520 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8b91fb0b-4201-418d-ba43-5dbd3b2c6261 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:44.058917 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8b91fb0b-4201-418d-ba43-5dbd3b2c6261 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:44.075169 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c993a53a-2d0a-480d-9bc8-8329b007e4ba tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:44.075935 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c993a53a-2d0a-480d-9bc8-8329b007e4ba tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:44.083894 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c993a53a-2d0a-480d-9bc8-8329b007e4ba tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:44.084804 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c993a53a-2d0a-480d-9bc8-8329b007e4ba tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:44.092197 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c993a53a-2d0a-480d-9bc8-8329b007e4ba tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:44.097289 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c993a53a-2d0a-480d-9bc8-8329b007e4ba tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:44.197611 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-8b91fb0b-4201-418d-ba43-5dbd3b2c6261 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9bcb3226f240a5951ab9971f6bb654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b2e4cb235e41da9ade19672bdd2e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:44.206714 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-8b91fb0b-4201-418d-ba43-5dbd3b2c6261 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] 10.222.0.16 "GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e" status: 200 len: 1218 microversion: 2.1 time: 0.174650 Jul 07 10:27:44.207291 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 108/200] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:44 2022] GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e => generated 1218 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:44.313354 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c993a53a-2d0a-480d-9bc8-8329b007e4ba tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:44.322665 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c993a53a-2d0a-480d-9bc8-8329b007e4ba tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1359 microversion: 2.1 time: 0.251215 Jul 07 10:27:44.324175 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 93/201] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:44 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1359 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:27:44.716035 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-b46a6cf3-3972-4642-bacd-f5ae0fcdd50a tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:44.717272 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-b46a6cf3-3972-4642-bacd-f5ae0fcdd50a tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: 192443a1-9b3b-4838-92b6-ac0031f4c767] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:44.723442 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b46a6cf3-3972-4642-bacd-f5ae0fcdd50a tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:44.724147 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b46a6cf3-3972-4642-bacd-f5ae0fcdd50a tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:44.725106 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b46a6cf3-3972-4642-bacd-f5ae0fcdd50a tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:44.726001 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b46a6cf3-3972-4642-bacd-f5ae0fcdd50a tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:44.892015 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-b46a6cf3-3972-4642-bacd-f5ae0fcdd50a tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:44.900785 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-b46a6cf3-3972-4642-bacd-f5ae0fcdd50a tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767" status: 200 len: 1503 microversion: 2.1 time: 0.189683 Jul 07 10:27:44.901367 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 109/202] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:44 2022] GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767 => generated 1503 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:44.970024 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1d8090e7-fc15-4ebd-a4a1-abf0e964fead tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:44.971321 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1d8090e7-fc15-4ebd-a4a1-abf0e964fead tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:44.980986 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1d8090e7-fc15-4ebd-a4a1-abf0e964fead tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:44.982701 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1d8090e7-fc15-4ebd-a4a1-abf0e964fead tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:44.984005 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1d8090e7-fc15-4ebd-a4a1-abf0e964fead tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:44.984458 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1d8090e7-fc15-4ebd-a4a1-abf0e964fead tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:45.179784 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-1d8090e7-fc15-4ebd-a4a1-abf0e964fead tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:45.188979 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:27:45.194638 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1d8090e7-fc15-4ebd-a4a1-abf0e964fead tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f" status: 200 len: 1522 microversion: 2.1 time: 0.229215 Jul 07 10:27:45.196600 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 94/203] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:44 2022] GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:45.223699 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-de45d034-ab83-44bb-a22f-6e05b2ac8901 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:45.224403 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-de45d034-ab83-44bb-a22f-6e05b2ac8901 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] [instance: 03a8b2e2-624f-44b3-81fb-f7bf6d23634e] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:45.231211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-de45d034-ab83-44bb-a22f-6e05b2ac8901 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:45.231879 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-de45d034-ab83-44bb-a22f-6e05b2ac8901 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:45.232726 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-de45d034-ab83-44bb-a22f-6e05b2ac8901 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:45.233393 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-de45d034-ab83-44bb-a22f-6e05b2ac8901 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:45.307116 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-de45d034-ab83-44bb-a22f-6e05b2ac8901 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9bcb3226f240a5951ab9971f6bb654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b2e4cb235e41da9ade19672bdd2e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:45.319461 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-de45d034-ab83-44bb-a22f-6e05b2ac8901 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] 10.222.0.16 "GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e" status: 200 len: 1218 microversion: 2.1 time: 0.099764 Jul 07 10:27:45.323879 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 110/204] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:45 2022] GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:45.345217 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9312dd80-3c5f-4a83-9822-a888e27114c2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:45.346963 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-9312dd80-3c5f-4a83-9822-a888e27114c2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:45.354301 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9312dd80-3c5f-4a83-9822-a888e27114c2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:45.354836 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9312dd80-3c5f-4a83-9822-a888e27114c2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:45.355635 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9312dd80-3c5f-4a83-9822-a888e27114c2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:45.356073 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9312dd80-3c5f-4a83-9822-a888e27114c2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:45.542493 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9312dd80-3c5f-4a83-9822-a888e27114c2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:45.559394 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9312dd80-3c5f-4a83-9822-a888e27114c2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1359 microversion: 2.1 time: 0.219399 Jul 07 10:27:45.560571 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 95/205] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:45 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:45.920659 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-86d4c009-903a-474a-a035-1d73388d4aed tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:45.927587 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-86d4c009-903a-474a-a035-1d73388d4aed tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: 192443a1-9b3b-4838-92b6-ac0031f4c767] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:45.935228 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell0:SELECT=2 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:27:45.937886 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-86d4c009-903a-474a-a035-1d73388d4aed tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:45.938718 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-86d4c009-903a-474a-a035-1d73388d4aed tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:45.939993 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-86d4c009-903a-474a-a035-1d73388d4aed tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:45.940645 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-86d4c009-903a-474a-a035-1d73388d4aed tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:46.091936 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-86d4c009-903a-474a-a035-1d73388d4aed tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:46.100960 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-86d4c009-903a-474a-a035-1d73388d4aed tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767" status: 200 len: 1503 microversion: 2.1 time: 0.186446 Jul 07 10:27:46.101792 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 111/206] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:45 2022] GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767 => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:46.214750 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-70872db6-afd5-4e56-b5b0-7524a470102e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:46.215370 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-70872db6-afd5-4e56-b5b0-7524a470102e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:46.221886 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-70872db6-afd5-4e56-b5b0-7524a470102e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:46.222346 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-70872db6-afd5-4e56-b5b0-7524a470102e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:46.223115 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-70872db6-afd5-4e56-b5b0-7524a470102e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:46.223560 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-70872db6-afd5-4e56-b5b0-7524a470102e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:46.341269 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-50e2484e-e04b-4415-ad26-71d51d9d9c1e tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:46.341994 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-50e2484e-e04b-4415-ad26-71d51d9d9c1e tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] [instance: 03a8b2e2-624f-44b3-81fb-f7bf6d23634e] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:46.355202 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-50e2484e-e04b-4415-ad26-71d51d9d9c1e tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:46.365681 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-50e2484e-e04b-4415-ad26-71d51d9d9c1e tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:46.366645 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-50e2484e-e04b-4415-ad26-71d51d9d9c1e tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:46.367106 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-50e2484e-e04b-4415-ad26-71d51d9d9c1e tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:46.441586 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-70872db6-afd5-4e56-b5b0-7524a470102e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:46.453845 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-70872db6-afd5-4e56-b5b0-7524a470102e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f" status: 200 len: 1522 microversion: 2.1 time: 0.244085 Jul 07 10:27:46.455032 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 96/207] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:46 2022] GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:46.519205 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-50e2484e-e04b-4415-ad26-71d51d9d9c1e tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9bcb3226f240a5951ab9971f6bb654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b2e4cb235e41da9ade19672bdd2e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:46.543884 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-50e2484e-e04b-4415-ad26-71d51d9d9c1e tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] 10.222.0.16 "GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e" status: 200 len: 1218 microversion: 2.1 time: 0.208120 Jul 07 10:27:46.554100 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 112/208] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:46 2022] GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e => generated 1218 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:27:46.577822 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e81a1cc9-adcc-40e4-92eb-67cd83ae68ec tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:46.578635 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e81a1cc9-adcc-40e4-92eb-67cd83ae68ec tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:46.584790 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e81a1cc9-adcc-40e4-92eb-67cd83ae68ec tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:46.585240 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e81a1cc9-adcc-40e4-92eb-67cd83ae68ec tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:46.586009 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e81a1cc9-adcc-40e4-92eb-67cd83ae68ec tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:46.586479 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e81a1cc9-adcc-40e4-92eb-67cd83ae68ec tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:47.118833 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-be06df1c-a0ea-4f24-8a8b-2a479639e779 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:47.120092 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-be06df1c-a0ea-4f24-8a8b-2a479639e779 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: 192443a1-9b3b-4838-92b6-ac0031f4c767] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:47.126547 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e81a1cc9-adcc-40e4-92eb-67cd83ae68ec tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:47.138406 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-be06df1c-a0ea-4f24-8a8b-2a479639e779 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:47.138797 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-be06df1c-a0ea-4f24-8a8b-2a479639e779 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:47.152243 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e81a1cc9-adcc-40e4-92eb-67cd83ae68ec tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1359 microversion: 2.1 time: 0.561266 Jul 07 10:27:47.153172 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 97/209] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:46 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1359 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:47.154582 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-be06df1c-a0ea-4f24-8a8b-2a479639e779 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:47.155262 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-be06df1c-a0ea-4f24-8a8b-2a479639e779 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:47.422695 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-be06df1c-a0ea-4f24-8a8b-2a479639e779 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:47.432712 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-be06df1c-a0ea-4f24-8a8b-2a479639e779 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767" status: 200 len: 1503 microversion: 2.1 time: 0.317684 Jul 07 10:27:47.435127 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 113/210] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:47 2022] GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767 => generated 1503 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:47.473567 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-04884c8f-d056-45b5-9c8a-da577552cc04 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:47.474322 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-04884c8f-d056-45b5-9c8a-da577552cc04 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:47.485999 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-04884c8f-d056-45b5-9c8a-da577552cc04 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:47.486494 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-04884c8f-d056-45b5-9c8a-da577552cc04 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:47.487465 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-04884c8f-d056-45b5-9c8a-da577552cc04 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:47.487909 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-04884c8f-d056-45b5-9c8a-da577552cc04 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:47.564253 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a1cdd9d2-39db-419e-8e54-762985c88194 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:47.569690 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-a1cdd9d2-39db-419e-8e54-762985c88194 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] [instance: 03a8b2e2-624f-44b3-81fb-f7bf6d23634e] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:47.581048 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a1cdd9d2-39db-419e-8e54-762985c88194 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:47.582193 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a1cdd9d2-39db-419e-8e54-762985c88194 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:47.583842 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a1cdd9d2-39db-419e-8e54-762985c88194 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:47.584670 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a1cdd9d2-39db-419e-8e54-762985c88194 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:47.756315 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-a1cdd9d2-39db-419e-8e54-762985c88194 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9bcb3226f240a5951ab9971f6bb654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b2e4cb235e41da9ade19672bdd2e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:47.767192 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-a1cdd9d2-39db-419e-8e54-762985c88194 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] 10.222.0.16 "GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e" status: 200 len: 1218 microversion: 2.1 time: 0.208782 Jul 07 10:27:47.779257 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 114/211] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:47 2022] GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e => generated 1218 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:47.831859 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-04884c8f-d056-45b5-9c8a-da577552cc04 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:47.844189 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-04884c8f-d056-45b5-9c8a-da577552cc04 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f" status: 200 len: 1522 microversion: 2.1 time: 0.374516 Jul 07 10:27:47.844793 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 98/212] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:47 2022] GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:48.173356 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-33372bff-8985-4429-b5d5-2fb9b3ccb71a tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:48.175160 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-33372bff-8985-4429-b5d5-2fb9b3ccb71a tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:48.200978 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-33372bff-8985-4429-b5d5-2fb9b3ccb71a tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:48.201715 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-33372bff-8985-4429-b5d5-2fb9b3ccb71a tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:48.202715 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-33372bff-8985-4429-b5d5-2fb9b3ccb71a tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:48.203223 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-33372bff-8985-4429-b5d5-2fb9b3ccb71a tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:48.451671 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-bf423529-2edf-4a7f-932e-89e689de939f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:48.452345 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-bf423529-2edf-4a7f-932e-89e689de939f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: 192443a1-9b3b-4838-92b6-ac0031f4c767] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:48.462704 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bf423529-2edf-4a7f-932e-89e689de939f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:48.463160 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bf423529-2edf-4a7f-932e-89e689de939f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:48.464116 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bf423529-2edf-4a7f-932e-89e689de939f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:48.464669 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bf423529-2edf-4a7f-932e-89e689de939f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:48.471631 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-33372bff-8985-4429-b5d5-2fb9b3ccb71a tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:48.485750 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-33372bff-8985-4429-b5d5-2fb9b3ccb71a tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1359 microversion: 2.1 time: 0.316988 Jul 07 10:27:48.498130 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 115/213] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:48 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1359 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:27:48.685128 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-bf423529-2edf-4a7f-932e-89e689de939f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:48.707309 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-bf423529-2edf-4a7f-932e-89e689de939f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767" status: 200 len: 1503 microversion: 2.1 time: 0.259723 Jul 07 10:27:48.718860 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 99/214] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:48 2022] GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767 => generated 1503 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:27:48.793840 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-5b297651-1b13-4fb2-a82e-44eb3ef68897 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:48.794530 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-5b297651-1b13-4fb2-a82e-44eb3ef68897 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] [instance: 03a8b2e2-624f-44b3-81fb-f7bf6d23634e] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:48.800958 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5b297651-1b13-4fb2-a82e-44eb3ef68897 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:48.801501 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5b297651-1b13-4fb2-a82e-44eb3ef68897 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:48.802331 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5b297651-1b13-4fb2-a82e-44eb3ef68897 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:48.803385 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5b297651-1b13-4fb2-a82e-44eb3ef68897 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:48.861779 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c1f38908-87e5-42de-83d1-91c6fc7ae2dc tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:48.862775 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c1f38908-87e5-42de-83d1-91c6fc7ae2dc tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:48.874690 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c1f38908-87e5-42de-83d1-91c6fc7ae2dc tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:48.875564 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c1f38908-87e5-42de-83d1-91c6fc7ae2dc tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:48.877177 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c1f38908-87e5-42de-83d1-91c6fc7ae2dc tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:48.880891 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c1f38908-87e5-42de-83d1-91c6fc7ae2dc tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:48.926508 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-5b297651-1b13-4fb2-a82e-44eb3ef68897 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9bcb3226f240a5951ab9971f6bb654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b2e4cb235e41da9ade19672bdd2e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:48.950900 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-5b297651-1b13-4fb2-a82e-44eb3ef68897 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] 10.222.0.16 "GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e" status: 200 len: 1218 microversion: 2.1 time: 0.161664 Jul 07 10:27:48.951899 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 116/215] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:48 2022] GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e => generated 1218 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:49.089040 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c1f38908-87e5-42de-83d1-91c6fc7ae2dc tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:49.099313 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c1f38908-87e5-42de-83d1-91c6fc7ae2dc tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f" status: 200 len: 1522 microversion: 2.1 time: 0.241155 Jul 07 10:27:49.100181 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 100/216] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:48 2022] GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:49.511572 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-244adf7c-33be-42d8-b525-8473c89e70bd tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:49.512229 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-244adf7c-33be-42d8-b525-8473c89e70bd tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:49.534954 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-244adf7c-33be-42d8-b525-8473c89e70bd tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:49.535684 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-244adf7c-33be-42d8-b525-8473c89e70bd tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:49.536771 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-244adf7c-33be-42d8-b525-8473c89e70bd tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:49.542529 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-244adf7c-33be-42d8-b525-8473c89e70bd tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:49.726376 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-10c2feec-9e3b-4eac-b994-5bb1b5fc56c1 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:49.727561 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-10c2feec-9e3b-4eac-b994-5bb1b5fc56c1 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: 192443a1-9b3b-4838-92b6-ac0031f4c767] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:49.744165 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-10c2feec-9e3b-4eac-b994-5bb1b5fc56c1 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:49.748995 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-10c2feec-9e3b-4eac-b994-5bb1b5fc56c1 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:49.751077 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-10c2feec-9e3b-4eac-b994-5bb1b5fc56c1 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:49.755690 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-10c2feec-9e3b-4eac-b994-5bb1b5fc56c1 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:49.813026 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-244adf7c-33be-42d8-b525-8473c89e70bd tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:49.821391 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-244adf7c-33be-42d8-b525-8473c89e70bd tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1359 microversion: 2.1 time: 0.321290 Jul 07 10:27:49.826012 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 117/217] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:49 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1359 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:49.968873 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-f301882b-3fbe-4a63-aca1-af567717c098 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:49.969955 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-f301882b-3fbe-4a63-aca1-af567717c098 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] [instance: 03a8b2e2-624f-44b3-81fb-f7bf6d23634e] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:49.982749 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f301882b-3fbe-4a63-aca1-af567717c098 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:49.993390 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f301882b-3fbe-4a63-aca1-af567717c098 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:50.001592 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f301882b-3fbe-4a63-aca1-af567717c098 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:50.002188 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f301882b-3fbe-4a63-aca1-af567717c098 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:50.016552 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-10c2feec-9e3b-4eac-b994-5bb1b5fc56c1 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:50.030625 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-10c2feec-9e3b-4eac-b994-5bb1b5fc56c1 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767" status: 200 len: 1503 microversion: 2.1 time: 0.306323 Jul 07 10:27:50.033215 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 101/218] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:49 2022] GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767 => generated 1503 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:27:50.119438 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8c5d1718-ebc6-498b-8d5a-800a403f92a2 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:50.120240 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8c5d1718-ebc6-498b-8d5a-800a403f92a2 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:50.135468 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8c5d1718-ebc6-498b-8d5a-800a403f92a2 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:50.138477 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8c5d1718-ebc6-498b-8d5a-800a403f92a2 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:50.140781 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8c5d1718-ebc6-498b-8d5a-800a403f92a2 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:50.141534 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8c5d1718-ebc6-498b-8d5a-800a403f92a2 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:50.141895 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-f301882b-3fbe-4a63-aca1-af567717c098 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9bcb3226f240a5951ab9971f6bb654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b2e4cb235e41da9ade19672bdd2e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:50.152155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-f301882b-3fbe-4a63-aca1-af567717c098 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] 10.222.0.16 "GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e" status: 200 len: 1218 microversion: 2.1 time: 0.185933 Jul 07 10:27:50.153022 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 118/219] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:49 2022] GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e => generated 1218 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:50.615779 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8c5d1718-ebc6-498b-8d5a-800a403f92a2 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:50.630507 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8c5d1718-ebc6-498b-8d5a-800a403f92a2 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f" status: 200 len: 1522 microversion: 2.1 time: 0.516927 Jul 07 10:27:50.631391 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 102/220] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:50 2022] GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f => generated 1522 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:27:50.843150 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-072f075b-8550-4181-beea-e3f3b18e6e88 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:50.843780 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-072f075b-8550-4181-beea-e3f3b18e6e88 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:50.849914 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-072f075b-8550-4181-beea-e3f3b18e6e88 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:50.850453 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-072f075b-8550-4181-beea-e3f3b18e6e88 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:50.851294 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-072f075b-8550-4181-beea-e3f3b18e6e88 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:50.852466 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-072f075b-8550-4181-beea-e3f3b18e6e88 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:50.983414 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-072f075b-8550-4181-beea-e3f3b18e6e88 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:50.986851 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=100 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:27:50.992698 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-072f075b-8550-4181-beea-e3f3b18e6e88 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1359 microversion: 2.1 time: 0.153480 Jul 07 10:27:50.993292 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 119/221] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:50 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:51.048135 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-01258751-7849-47bc-b8a7-807d6032538a tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:51.048815 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-01258751-7849-47bc-b8a7-807d6032538a tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: 192443a1-9b3b-4838-92b6-ac0031f4c767] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:51.056148 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-01258751-7849-47bc-b8a7-807d6032538a tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:51.056597 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-01258751-7849-47bc-b8a7-807d6032538a tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:51.057359 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-01258751-7849-47bc-b8a7-807d6032538a tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:51.057788 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-01258751-7849-47bc-b8a7-807d6032538a tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:51.170040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-e8fbfd8a-c010-4f01-97a2-56999963a17a tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:51.171125 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-e8fbfd8a-c010-4f01-97a2-56999963a17a tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] [instance: 03a8b2e2-624f-44b3-81fb-f7bf6d23634e] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:51.177933 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e8fbfd8a-c010-4f01-97a2-56999963a17a tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:51.178714 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e8fbfd8a-c010-4f01-97a2-56999963a17a tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:51.179731 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e8fbfd8a-c010-4f01-97a2-56999963a17a tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:51.180471 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e8fbfd8a-c010-4f01-97a2-56999963a17a tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:51.198730 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-01258751-7849-47bc-b8a7-807d6032538a tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:51.226224 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-01258751-7849-47bc-b8a7-807d6032538a tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767" status: 200 len: 1503 microversion: 2.1 time: 0.181852 Jul 07 10:27:51.235968 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 103/222] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:51 2022] GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767 => generated 1503 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:51.262930 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-e8fbfd8a-c010-4f01-97a2-56999963a17a tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9bcb3226f240a5951ab9971f6bb654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b2e4cb235e41da9ade19672bdd2e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:51.270266 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-e8fbfd8a-c010-4f01-97a2-56999963a17a tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] 10.222.0.16 "GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e" status: 200 len: 1218 microversion: 2.1 time: 0.104685 Jul 07 10:27:51.270992 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 120/223] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:51 2022] GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:27:51.649325 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-073044ae-b554-4039-868e-0d9ef21e017a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:51.650001 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-073044ae-b554-4039-868e-0d9ef21e017a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:51.656965 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-073044ae-b554-4039-868e-0d9ef21e017a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:51.657418 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-073044ae-b554-4039-868e-0d9ef21e017a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:51.658185 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-073044ae-b554-4039-868e-0d9ef21e017a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:51.658623 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-073044ae-b554-4039-868e-0d9ef21e017a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:51.688643 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:27:51.707105 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=12 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:27:51.947481 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-9d78e789-925d-4c93-9a24-1c67c3ff227a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1499114835", "imageRef": "1c96509d-f65f-42b0-94b3-6fc590a93508", "flavorRef": "452", "networks": [{"uuid": "b3e89720-1b64-4314-83e5-302338369447"}]}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:27:51.954278 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell0:SELECT=8 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:27:51.999147 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.network.neutron [None req-9d78e789-925d-4c93-9a24-1c67c3ff227a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] validate_networks() for [('b3e89720-1b64-4314-83e5-302338369447', None, None, None, None, None)] {{(pid=117646) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 10:27:52.056290 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-073044ae-b554-4039-868e-0d9ef21e017a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:52.065335 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-073044ae-b554-4039-868e-0d9ef21e017a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f" status: 200 len: 1522 microversion: 2.1 time: 0.421314 Jul 07 10:27:52.066144 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 104/224] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:51 2022] GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f => generated 1522 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:52.072441 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-071827fd-35ea-4e60-924f-14c55bb87edf tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:52.073238 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-071827fd-35ea-4e60-924f-14c55bb87edf tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:52.084640 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-071827fd-35ea-4e60-924f-14c55bb87edf tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:52.085342 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-071827fd-35ea-4e60-924f-14c55bb87edf tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:52.087504 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-071827fd-35ea-4e60-924f-14c55bb87edf tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:52.088195 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-071827fd-35ea-4e60-924f-14c55bb87edf tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:52.406592 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-071827fd-35ea-4e60-924f-14c55bb87edf tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:52.416243 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-071827fd-35ea-4e60-924f-14c55bb87edf tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1359 microversion: 2.1 time: 0.348686 Jul 07 10:27:52.417186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 105/225] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:52 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1359 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:52.436751 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-67cc07f3-2ce1-43b4-bb3e-5869e387c6fd tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:52.437694 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-67cc07f3-2ce1-43b4-bb3e-5869e387c6fd tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: 192443a1-9b3b-4838-92b6-ac0031f4c767] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:52.452635 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-67cc07f3-2ce1-43b4-bb3e-5869e387c6fd tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:52.453398 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-67cc07f3-2ce1-43b4-bb3e-5869e387c6fd tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:52.455250 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-67cc07f3-2ce1-43b4-bb3e-5869e387c6fd tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:52.456193 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-67cc07f3-2ce1-43b4-bb3e-5869e387c6fd tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:52.609398 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-67cc07f3-2ce1-43b4-bb3e-5869e387c6fd tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:52.618894 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-67cc07f3-2ce1-43b4-bb3e-5869e387c6fd tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767" status: 200 len: 1461 microversion: 2.1 time: 0.187346 Jul 07 10:27:52.619469 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 106/226] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:52 2022] GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767 => generated 1461 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:52.634478 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b0c45a86-b815-4436-9c74-670eaca00a18 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:52.635106 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b0c45a86-b815-4436-9c74-670eaca00a18 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] [instance: 03a8b2e2-624f-44b3-81fb-f7bf6d23634e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:52.642632 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b0c45a86-b815-4436-9c74-670eaca00a18 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:52.643125 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b0c45a86-b815-4436-9c74-670eaca00a18 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:52.643947 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b0c45a86-b815-4436-9c74-670eaca00a18 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:52.644514 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b0c45a86-b815-4436-9c74-670eaca00a18 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:52.749425 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-9d78e789-925d-4c93-9a24-1c67c3ff227a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Flavor limits 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 10:27:52.750090 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-9d78e789-925d-4c93-9a24-1c67c3ff227a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Image limits 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 10:27:52.750778 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-9d78e789-925d-4c93-9a24-1c67c3ff227a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Flavor pref 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 10:27:52.751781 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-9d78e789-925d-4c93-9a24-1c67c3ff227a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Image pref 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 10:27:52.752519 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-9d78e789-925d-4c93-9a24-1c67c3ff227a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 10:27:52.769503 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9d78e789-925d-4c93-9a24-1c67c3ff227a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:52.770206 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9d78e789-925d-4c93-9a24-1c67c3ff227a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:52.770351 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b0c45a86-b815-4436-9c74-670eaca00a18 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9bcb3226f240a5951ab9971f6bb654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b2e4cb235e41da9ade19672bdd2e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:52.771390 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9d78e789-925d-4c93-9a24-1c67c3ff227a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:52.772238 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9d78e789-925d-4c93-9a24-1c67c3ff227a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:52.786407 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b0c45a86-b815-4436-9c74-670eaca00a18 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] 10.222.0.16 "GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e" status: 200 len: 1266 microversion: 2.1 time: 0.165429 Jul 07 10:27:52.787258 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 107/227] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:52 2022] GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:52.796861 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-9d78e789-925d-4c93-9a24-1c67c3ff227a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Getting quotas for project 1bd64979a2bc4ca6be57262f4387920e. Resources: {'cores', 'ram', 'instances'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:27:52.800934 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0a87984b-03a9-47fd-a4df-d321560b13ca tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:52.801432 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0a87984b-03a9-47fd-a4df-d321560b13ca tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:52.802412 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-9d78e789-925d-4c93-9a24-1c67c3ff227a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Getting quotas for user 9476865e0b114996b2c0ffce9fca16a2 and project 1bd64979a2bc4ca6be57262f4387920e. Resources: {'cores', 'ram', 'instances'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:27:52.816701 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0a87984b-03a9-47fd-a4df-d321560b13ca tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:52.817166 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0a87984b-03a9-47fd-a4df-d321560b13ca tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:52.817927 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0a87984b-03a9-47fd-a4df-d321560b13ca tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:52.818357 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0a87984b-03a9-47fd-a4df-d321560b13ca tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:52.824590 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-9d78e789-925d-4c93-9a24-1c67c3ff227a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Going to run 1 instances... {{(pid=117646) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 10:27:52.834497 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-9d78e789-925d-4c93-9a24-1c67c3ff227a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c96509d-f65f-42b0-94b3-6fc590a93508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 10:27:52.882178 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:27:52.886595 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0a87984b-03a9-47fd-a4df-d321560b13ca tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0/ips" status: 200 len: 146 microversion: 2.1 time: 0.098057 Jul 07 10:27:52.887504 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 108/228] 10.222.0.16 () {58 vars in 1247 bytes} [Thu Jul 7 10:27:52 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0/ips => generated 146 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:27:52.891935 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-4c1d00f1-1c63-4b9a-8c20-b0d5c4680bdb req-33eb7071-28d4-47d8-8362-07a2dbd0e6b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "192443a1-9b3b-4838-92b6-ac0031f4c767", "name": "network-vif-deleted", "tag": "fa036119-0380-421c-bdbb-88402fea7f30"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:27:52.909466 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-9d78e789-925d-4c93-9a24-1c67c3ff227a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.966339 Jul 07 10:27:52.910601 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 121/229] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jul 7 10:27:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 10:27:52.922737 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-4c1d00f1-1c63-4b9a-8c20-b0d5c4680bdb req-33eb7071-28d4-47d8-8362-07a2dbd0e6b8 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:52.923381 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-4c1d00f1-1c63-4b9a-8c20-b0d5c4680bdb req-33eb7071-28d4-47d8-8362-07a2dbd0e6b8 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:52.924345 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-122fb40c-7e88-4d5a-b02f-c83dcbf99cf3 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:52.927388 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-122fb40c-7e88-4d5a-b02f-c83dcbf99cf3 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:52.961010 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-4c1d00f1-1c63-4b9a-8c20-b0d5c4680bdb req-33eb7071-28d4-47d8-8362-07a2dbd0e6b8 service nova] Creating event network-vif-deleted:fa036119-0380-421c-bdbb-88402fea7f30 for instance 192443a1-9b3b-4838-92b6-ac0031f4c767 on hv-cinder-82282 Jul 07 10:27:52.991231 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-4c1d00f1-1c63-4b9a-8c20-b0d5c4680bdb req-33eb7071-28d4-47d8-8362-07a2dbd0e6b8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102316 Jul 07 10:27:52.992588 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 109/230] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:27:53.036912 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-122fb40c-7e88-4d5a-b02f-c83dcbf99cf3 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:53.048794 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-122fb40c-7e88-4d5a-b02f-c83dcbf99cf3 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6" status: 200 len: 1219 microversion: 2.1 time: 0.131113 Jul 07 10:27:53.052188 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 122/231] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:52 2022] GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 => generated 1219 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:53.100073 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2f065c30-7839-4996-a41b-7eb5877fd7b2 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:53.102720 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-2f065c30-7839-4996-a41b-7eb5877fd7b2 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:53.116470 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2f065c30-7839-4996-a41b-7eb5877fd7b2 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:53.117550 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2f065c30-7839-4996-a41b-7eb5877fd7b2 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:53.118639 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2f065c30-7839-4996-a41b-7eb5877fd7b2 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:53.119563 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2f065c30-7839-4996-a41b-7eb5877fd7b2 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:53.434340 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-71805be3-2cc2-410b-99f4-14cfc675622c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:53.435203 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-71805be3-2cc2-410b-99f4-14cfc675622c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:53.444010 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-71805be3-2cc2-410b-99f4-14cfc675622c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:53.444877 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-71805be3-2cc2-410b-99f4-14cfc675622c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:53.446579 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-71805be3-2cc2-410b-99f4-14cfc675622c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:53.447189 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-71805be3-2cc2-410b-99f4-14cfc675622c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:53.511848 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-2f065c30-7839-4996-a41b-7eb5877fd7b2 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:53.541231 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-2f065c30-7839-4996-a41b-7eb5877fd7b2 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f" status: 200 len: 1522 microversion: 2.1 time: 0.461595 Jul 07 10:27:53.553670 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 110/232] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:53 2022] GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f => generated 1522 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:53.636723 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-33f9623f-49b1-4a0e-978b-5d8a7446f7ef tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:53.637345 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-33f9623f-49b1-4a0e-978b-5d8a7446f7ef tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: 192443a1-9b3b-4838-92b6-ac0031f4c767] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:53.650927 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-33f9623f-49b1-4a0e-978b-5d8a7446f7ef tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:53.651492 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-33f9623f-49b1-4a0e-978b-5d8a7446f7ef tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:53.653362 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-33f9623f-49b1-4a0e-978b-5d8a7446f7ef tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:53.654008 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-33f9623f-49b1-4a0e-978b-5d8a7446f7ef tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:53.698644 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:27:53.706493 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-33f9623f-49b1-4a0e-978b-5d8a7446f7ef tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:53.707153 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-33f9623f-49b1-4a0e-978b-5d8a7446f7ef tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:53.707791 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.objects.instance [None req-33f9623f-49b1-4a0e-978b-5d8a7446f7ef tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lazy-loading 'fault' on Instance uuid 192443a1-9b3b-4838-92b6-ac0031f4c767 {{(pid=117647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 10:27:53.763203 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-71805be3-2cc2-410b-99f4-14cfc675622c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:53.776788 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-71805be3-2cc2-410b-99f4-14cfc675622c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1359 microversion: 2.1 time: 0.346920 Jul 07 10:27:53.787824 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 123/233] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:53 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1359 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:27:53.804682 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-4d0540df-0035-4063-aa4a-8d9edc3404e9 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:53.805841 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-4d0540df-0035-4063-aa4a-8d9edc3404e9 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] [instance: 03a8b2e2-624f-44b3-81fb-f7bf6d23634e] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:53.812086 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4d0540df-0035-4063-aa4a-8d9edc3404e9 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:53.812534 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4d0540df-0035-4063-aa4a-8d9edc3404e9 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:53.813302 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4d0540df-0035-4063-aa4a-8d9edc3404e9 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:53.813736 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4d0540df-0035-4063-aa4a-8d9edc3404e9 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:53.889215 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-4d0540df-0035-4063-aa4a-8d9edc3404e9 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9bcb3226f240a5951ab9971f6bb654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b2e4cb235e41da9ade19672bdd2e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:53.899001 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-4d0540df-0035-4063-aa4a-8d9edc3404e9 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] 10.222.0.16 "GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e" status: 200 len: 1272 microversion: 2.1 time: 0.098021 Jul 07 10:27:53.901035 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 124/234] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:53 2022] GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e => generated 1272 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:27:53.966829 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-33f9623f-49b1-4a0e-978b-5d8a7446f7ef tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:53.982028 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-33f9623f-49b1-4a0e-978b-5d8a7446f7ef tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767" status: 200 len: 1303 microversion: 2.1 time: 0.349753 Jul 07 10:27:53.982624 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 111/235] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:53 2022] GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767 => generated 1303 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:54.073047 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-cdb47f56-03e8-49cc-abc6-550f782ad043 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:54.074313 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-cdb47f56-03e8-49cc-abc6-550f782ad043 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:54.086382 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-cdb47f56-03e8-49cc-abc6-550f782ad043 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:54.087157 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-cdb47f56-03e8-49cc-abc6-550f782ad043 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:54.091508 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-cdb47f56-03e8-49cc-abc6-550f782ad043 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:54.092390 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-cdb47f56-03e8-49cc-abc6-550f782ad043 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:54.181436 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-cdb47f56-03e8-49cc-abc6-550f782ad043 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:54.189620 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-cdb47f56-03e8-49cc-abc6-550f782ad043 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6" status: 200 len: 1271 microversion: 2.1 time: 0.122952 Jul 07 10:27:54.190717 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 125/236] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:54 2022] GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 => generated 1271 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:54.560578 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-14f97681-fdc1-4d69-a292-418b6343bdf3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:54.561116 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-14f97681-fdc1-4d69-a292-418b6343bdf3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:54.568010 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-14f97681-fdc1-4d69-a292-418b6343bdf3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:54.568461 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-14f97681-fdc1-4d69-a292-418b6343bdf3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:54.569240 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-14f97681-fdc1-4d69-a292-418b6343bdf3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:54.569929 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-14f97681-fdc1-4d69-a292-418b6343bdf3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:54.575372 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=100 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:27:54.796569 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-5e6fd2a3-50ed-4e56-9a71-78096657f6d3 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:54.797750 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-5e6fd2a3-50ed-4e56-9a71-78096657f6d3 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:54.805462 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5e6fd2a3-50ed-4e56-9a71-78096657f6d3 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:54.807100 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5e6fd2a3-50ed-4e56-9a71-78096657f6d3 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:54.808604 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5e6fd2a3-50ed-4e56-9a71-78096657f6d3 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:54.809455 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5e6fd2a3-50ed-4e56-9a71-78096657f6d3 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:54.874941 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-14f97681-fdc1-4d69-a292-418b6343bdf3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:54.884954 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-14f97681-fdc1-4d69-a292-418b6343bdf3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f" status: 200 len: 1522 microversion: 2.1 time: 0.330293 Jul 07 10:27:54.885536 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 112/237] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:54 2022] GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:54.916408 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2223eac0-dc9a-4fea-a599-a76dfa7a156d tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:54.917301 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-2223eac0-dc9a-4fea-a599-a76dfa7a156d tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] [instance: 03a8b2e2-624f-44b3-81fb-f7bf6d23634e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:54.931238 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2223eac0-dc9a-4fea-a599-a76dfa7a156d tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:54.931696 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2223eac0-dc9a-4fea-a599-a76dfa7a156d tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:54.932508 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2223eac0-dc9a-4fea-a599-a76dfa7a156d tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:54.932946 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2223eac0-dc9a-4fea-a599-a76dfa7a156d tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:55.003923 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-5e6fd2a3-50ed-4e56-9a71-78096657f6d3 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:55.014155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-5e6fd2a3-50ed-4e56-9a71-78096657f6d3 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1359 microversion: 2.1 time: 0.222038 Jul 07 10:27:55.014743 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 126/238] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:54 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:27:55.027355 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-f20d6f8f-18b9-49f5-81ea-d53975d7b1dd tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:55.027990 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-f20d6f8f-18b9-49f5-81ea-d53975d7b1dd tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: 192443a1-9b3b-4838-92b6-ac0031f4c767] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:55.036517 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f20d6f8f-18b9-49f5-81ea-d53975d7b1dd tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:55.036517 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f20d6f8f-18b9-49f5-81ea-d53975d7b1dd tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:55.037634 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f20d6f8f-18b9-49f5-81ea-d53975d7b1dd tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:55.037816 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f20d6f8f-18b9-49f5-81ea-d53975d7b1dd tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:55.053157 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.wsgi [None req-f20d6f8f-18b9-49f5-81ea-d53975d7b1dd tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] HTTP exception thrown: Instance 192443a1-9b3b-4838-92b6-ac0031f4c767 could not be found. Jul 07 10:27:55.055000 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-f20d6f8f-18b9-49f5-81ea-d53975d7b1dd tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Request method failure captured: Jul 07 10:27:55.055000 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767 HTTP/1.1 Jul 07 10:27:55.055000 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:27:55.055000 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:27:55.055000 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:27:55.055000 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 0 Jul 07 10:27:55.055000 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:27:55.055000 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:27:55.055000 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:27:55.055000 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:27:55.055000 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrUCGzeTuIsKcaWSWKTZjgGLMFvMGp6vaqqg1QGrnKHODOs32hu3VIe75VDNIwMeYpkFNJ9menDFl82_gMsV0AWRnXfy9XuxF6TFUGeQKZlz9m405gQx_fSGZDAU5psKBlV9qCfibR_AXqZl_LvtxvtzeHHtGHoqoo1Ob_NUsJUCEOo Jul 07 10:27:55.055000 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:27:55.055000 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:27:55.055000 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:27:55.055000 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:27:55.055000 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:27:55.055000 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:27:55.055000 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: 3d3b58b3beed423aba9a7c28d1e09c88 Jul 07 10:27:55.055000 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-VolumesActionsTest-415571155 Jul 07 10:27:55.055000 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:27:55.055000 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:27:55.056331 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d3b58b3beed423aba9a7c28d1e09c88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3d3b58b3beed423aba9a7c28d1e09c88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d3b58b3beed423aba9a7c28d1e09c88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3d3b58b3beed423aba9a7c28d1e09c88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:27:55.056331 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-VolumesActionsTest-415571155 Jul 07 10:27:55.056331 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: 3d3b58b3beed423aba9a7c28d1e09c88 Jul 07 10:27:55.056331 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-VolumesActionsTest-415571155 Jul 07 10:27:55.056331 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-VolumesActionsTest-415571155-project Jul 07 10:27:55.056331 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:27:55.056331 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:27:55.056331 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: f28b6a7ebf8c4cbab9193b95b8de6818 Jul 07 10:27:55.056331 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-VolumesActionsTest-415571155-project Jul 07 10:27:55.056331 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: > Jul 07 10:27:55.056331 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Instance 192443a1-9b3b-4838-92b6-ac0031f4c767 could not be found. Jul 07 10:27:55.056331 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'id': '192443a1-9b3b-4838-92b6-ac0031f4c767'} Jul 07 10:27:55.060684 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:27:55.060684 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:27:55.060684 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:27:55.060684 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:27:55.060684 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:27:55.060684 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:27:55.060684 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:27:55.060684 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:27:55.060684 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:27:55.060684 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:27:55.060684 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 192443a1-9b3b-4838-92b6-ac0031f4c767 could not be found. Jul 07 10:27:55.060684 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:27:55.060684 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:27:55.060684 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:27:55.060684 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:27:55.060684 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:27:55.060684 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:27:55.060684 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:27:55.060684 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:27:55.060684 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:27:55.071209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:27:55.071209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:27:55.071209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:27:55.071209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:27:55.071209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:27:55.071209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:27:55.071209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:27:55.071209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 192443a1-9b3b-4838-92b6-ac0031f4c767 could not be found. Jul 07 10:27:55.071209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:27:55.071209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:27:55.071209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:27:55.071209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:27:55.071209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:27:55.071209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:27:55.071209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:27:55.071209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:27:55.071209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 192443a1-9b3b-4838-92b6-ac0031f4c767 could not be found. Jul 07 10:27:55.071209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:27:55.072608 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-f20d6f8f-18b9-49f5-81ea-d53975d7b1dd tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Returning 404 to user: Instance 192443a1-9b3b-4838-92b6-ac0031f4c767 could not be found. {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:27:55.072608 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-f20d6f8f-18b9-49f5-81ea-d53975d7b1dd tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767" status: 404 len: 111 microversion: 2.1 time: 0.035101 Jul 07 10:27:55.072608 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 127/239] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:55 2022] GET /compute/v2.1/servers/192443a1-9b3b-4838-92b6-ac0031f4c767 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:27:55.072608 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-8ae6ccee-d3dd-40ec-aab6-bd6f316deea3 req-d0c75687-a2d1-4e7e-997f-133bb1d2a854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca65cd17-61ba-4122-ba4b-59953053de02", "tag": "9e1716e6-ca2c-42e2-be39-5e2596494efc"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:27:55.086845 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-8ae6ccee-d3dd-40ec-aab6-bd6f316deea3 req-d0c75687-a2d1-4e7e-997f-133bb1d2a854 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:55.092341 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-8ae6ccee-d3dd-40ec-aab6-bd6f316deea3 req-d0c75687-a2d1-4e7e-997f-133bb1d2a854 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:55.113626 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-8ae6ccee-d3dd-40ec-aab6-bd6f316deea3 req-d0c75687-a2d1-4e7e-997f-133bb1d2a854 service nova] Creating event network-changed:9e1716e6-ca2c-42e2-be39-5e2596494efc for instance ca65cd17-61ba-4122-ba4b-59953053de02 on hv-cinder-82282 Jul 07 10:27:55.124651 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-8ae6ccee-d3dd-40ec-aab6-bd6f316deea3 req-d0c75687-a2d1-4e7e-997f-133bb1d2a854 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065732 Jul 07 10:27:55.126304 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 128/240] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:27:55.194218 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-4f4814ee-5701-43a4-81a0-2ae7ceec9aac tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2137183315", "imageRef": "1c96509d-f65f-42b0-94b3-6fc590a93508", "flavorRef": "452", "networks": [{"uuid": "077a047b-f9c7-490e-ac9f-1de351d3c473"}]}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:27:55.212070 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-2223eac0-dc9a-4fea-a599-a76dfa7a156d tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9bcb3226f240a5951ab9971f6bb654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b2e4cb235e41da9ade19672bdd2e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:55.225958 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-2223eac0-dc9a-4fea-a599-a76dfa7a156d tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] 10.222.0.16 "GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e" status: 200 len: 1314 microversion: 2.1 time: 0.313284 Jul 07 10:27:55.226557 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 113/241] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:54 2022] GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:27:55.248281 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a609fb18-06ce-45c1-91d2-fbf4e0d0c527 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:55.250004 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a609fb18-06ce-45c1-91d2-fbf4e0d0c527 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:55.258622 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a609fb18-06ce-45c1-91d2-fbf4e0d0c527 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:55.259312 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a609fb18-06ce-45c1-91d2-fbf4e0d0c527 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:55.262951 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a609fb18-06ce-45c1-91d2-fbf4e0d0c527 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:55.263976 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a609fb18-06ce-45c1-91d2-fbf4e0d0c527 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:55.284889 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.network.neutron [None req-4f4814ee-5701-43a4-81a0-2ae7ceec9aac tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] validate_networks() for [('077a047b-f9c7-490e-ac9f-1de351d3c473', None, None, None, None, None)] {{(pid=117646) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 10:27:55.344839 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a609fb18-06ce-45c1-91d2-fbf4e0d0c527 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:55.355104 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a609fb18-06ce-45c1-91d2-fbf4e0d0c527 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6" status: 200 len: 1279 microversion: 2.1 time: 0.113992 Jul 07 10:27:55.355678 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 114/242] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:55 2022] GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 => generated 1279 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:55.370202 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-13fdb10c-bc40-40be-9ea2-6b4bddd86087 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "893fd455-c655-445b-a214-642b6a982dca"}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:27:55.371265 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-13fdb10c-bc40-40be-9ea2-6b4bddd86087 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:55.377625 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-13fdb10c-bc40-40be-9ea2-6b4bddd86087 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:55.378243 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-13fdb10c-bc40-40be-9ea2-6b4bddd86087 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:55.379064 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-13fdb10c-bc40-40be-9ea2-6b4bddd86087 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:55.379663 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-13fdb10c-bc40-40be-9ea2-6b4bddd86087 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:55.721769 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-4f4814ee-5701-43a4-81a0-2ae7ceec9aac tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Flavor limits 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 10:27:55.722190 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-4f4814ee-5701-43a4-81a0-2ae7ceec9aac tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Image limits 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 10:27:55.722658 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-4f4814ee-5701-43a4-81a0-2ae7ceec9aac tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Flavor pref 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 10:27:55.723095 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-4f4814ee-5701-43a4-81a0-2ae7ceec9aac tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Image pref 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 10:27:55.723501 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-4f4814ee-5701-43a4-81a0-2ae7ceec9aac tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 10:27:55.736163 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4f4814ee-5701-43a4-81a0-2ae7ceec9aac tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:55.736610 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4f4814ee-5701-43a4-81a0-2ae7ceec9aac tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:55.737543 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4f4814ee-5701-43a4-81a0-2ae7ceec9aac tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:55.737983 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4f4814ee-5701-43a4-81a0-2ae7ceec9aac tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:55.755671 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-4f4814ee-5701-43a4-81a0-2ae7ceec9aac tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Getting quotas for project 3d3b58b3beed423aba9a7c28d1e09c88. Resources: {'cores', 'ram', 'instances'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:27:55.759635 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-4f4814ee-5701-43a4-81a0-2ae7ceec9aac tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Getting quotas for user f28b6a7ebf8c4cbab9193b95b8de6818 and project 3d3b58b3beed423aba9a7c28d1e09c88. Resources: {'cores', 'ram', 'instances'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:27:55.777378 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-4f4814ee-5701-43a4-81a0-2ae7ceec9aac tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Going to run 1 instances... {{(pid=117646) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 10:27:55.779779 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-4f4814ee-5701-43a4-81a0-2ae7ceec9aac tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c96509d-f65f-42b0-94b3-6fc590a93508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 10:27:55.823163 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-4f4814ee-5701-43a4-81a0-2ae7ceec9aac tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.634304 Jul 07 10:27:55.823837 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 129/243] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jul 7 10:27:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 10:27:55.834068 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-3ee448d1-9886-41e8-af1a-698a83c16be5 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:55.834644 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-3ee448d1-9886-41e8-af1a-698a83c16be5 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:55.888286 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-3ee448d1-9886-41e8-af1a-698a83c16be5 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:55.895849 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-3ee448d1-9886-41e8-af1a-698a83c16be5 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25" status: 200 len: 1214 microversion: 2.1 time: 0.066050 Jul 07 10:27:55.896416 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 130/244] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:55 2022] GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:27:55.905074 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-29fa5482-53f6-43de-9680-69cc9eb70916 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:55.905720 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-29fa5482-53f6-43de-9680-69cc9eb70916 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:55.911990 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-29fa5482-53f6-43de-9680-69cc9eb70916 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:55.912451 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-29fa5482-53f6-43de-9680-69cc9eb70916 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:55.913220 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-29fa5482-53f6-43de-9680-69cc9eb70916 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:55.913655 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-29fa5482-53f6-43de-9680-69cc9eb70916 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:56.054683 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-29fa5482-53f6-43de-9680-69cc9eb70916 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:56.079224 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-29fa5482-53f6-43de-9680-69cc9eb70916 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f" status: 200 len: 1502 microversion: 2.1 time: 0.178241 Jul 07 10:27:56.079951 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 131/245] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:55 2022] GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f => generated 1502 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:56.099036 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-d0e25cd4-1512-4b69-85e6-180237867db4 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:56.099682 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-d0e25cd4-1512-4b69-85e6-180237867db4 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:56.120426 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d0e25cd4-1512-4b69-85e6-180237867db4 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:56.120798 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d0e25cd4-1512-4b69-85e6-180237867db4 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:56.121602 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d0e25cd4-1512-4b69-85e6-180237867db4 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:56.125650 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d0e25cd4-1512-4b69-85e6-180237867db4 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:56.377724 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-13fdb10c-bc40-40be-9ea2-6b4bddd86087 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "POST /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.012035 Jul 07 10:27:56.379805 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 115/246] 10.222.0.16 () {60 vars in 1322 bytes} [Thu Jul 7 10:27:55 2022] POST /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0/os-volume_attachments => generated 194 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:27:56.410468 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c2cd1c41-f475-4ed1-b744-681ca4cda46a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3d999b5-c601-4e35-9853-292c633c5e7c"}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:27:56.411893 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c2cd1c41-f475-4ed1-b744-681ca4cda46a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:56.419333 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c2cd1c41-f475-4ed1-b744-681ca4cda46a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:56.420299 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c2cd1c41-f475-4ed1-b744-681ca4cda46a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:56.421741 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c2cd1c41-f475-4ed1-b744-681ca4cda46a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:56.423045 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c2cd1c41-f475-4ed1-b744-681ca4cda46a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:56.470013 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-d0e25cd4-1512-4b69-85e6-180237867db4 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:56.478799 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-d0e25cd4-1512-4b69-85e6-180237867db4 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1359 microversion: 2.1 time: 0.394729 Jul 07 10:27:56.489642 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 132/247] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:56 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1359 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:56.495015 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-c2cd1c41-f475-4ed1-b744-681ca4cda46a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] HTTP exception thrown: Cannot 'attach_volume' instance 1a1d0d51-844a-4a45-9f11-71081578d56f while it is in vm_state rescued Jul 07 10:27:56.497050 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c2cd1c41-f475-4ed1-b744-681ca4cda46a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Request method failure captured: Jul 07 10:27:56.497050 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: request: POST /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f/os-volume_attachments HTTP/1.1 Jul 07 10:27:56.497050 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept: application/json Jul 07 10:27:56.497050 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jul 07 10:27:56.497050 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Connection: close Jul 07 10:27:56.497050 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Length: 74 Jul 07 10:27:56.497050 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jul 07 10:27:56.497050 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Host: 10.222.0.16 Jul 07 10:27:56.497050 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jul 07 10:27:56.497050 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jul 07 10:27:56.497050 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABixrS4oJkiQJ2S1nuTus8_u0pgmHtb2UVNyGp6_ugxW7QSRm-iSt8LOJAKl2ypHUM-taYWb6Bei6nHqf_-zMcUYULB9JjdSQtGpTGJBQ6G69lQK9O9rW3T1MeoKBWymStKrelTWl9C3QobvGGNXcuc-HNij8n2XMYSmetxBRApxPwJ7WE Jul 07 10:27:56.497050 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jul 07 10:27:56.497050 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jul 07 10:27:56.497050 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jul 07 10:27:56.497050 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jul 07 10:27:56.497050 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jul 07 10:27:56.497050 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jul 07 10:27:56.497050 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Id: 0a883b49db0f4f32a32bf6d87e2f6104 Jul 07 10:27:56.497050 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1851522730 Jul 07 10:27:56.497050 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jul 07 10:27:56.497050 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jul 07 10:27:56.498564 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a883b49db0f4f32a32bf6d87e2f6104"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0a883b49db0f4f32a32bf6d87e2f6104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a883b49db0f4f32a32bf6d87e2f6104"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0a883b49db0f4f32a32bf6d87e2f6104"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:27:56.498564 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1851522730 Jul 07 10:27:56.498564 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 0a883b49db0f4f32a32bf6d87e2f6104 Jul 07 10:27:56.498564 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1851522730 Jul 07 10:27:56.498564 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User: tempest-ServerRescueNegativeTestJSON-1851522730-project Jul 07 10:27:56.498564 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jul 07 10:27:56.498564 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jul 07 10:27:56.498564 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Id: 92b758b22f054dd991e8af99354a134f Jul 07 10:27:56.498564 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1851522730-project Jul 07 10:27:56.498564 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Jul 07 10:27:56.498564 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: {"volumeAttachment": {"volumeId": "d3d999b5-c601-4e35-9853-292c633c5e7c"}} Jul 07 10:27:56.498564 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: method: > Jul 07 10:27:56.499356 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: exception: Cannot 'attach_volume' instance 1a1d0d51-844a-4a45-9f11-71081578d56f while it is in vm_state rescued Jul 07 10:27:56.499356 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: action_args: {'server_id': '1a1d0d51-844a-4a45-9f11-71081578d56f', 'body': {'volumeAttachment': {'volumeId': 'd3d999b5-c601-4e35-9853-292c633c5e7c'}}} Jul 07 10:27:56.499356 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:27:56.499356 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:27:56.499356 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 07 10:27:56.499356 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 07 10:27:56.499356 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 07 10:27:56.499356 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 07 10:27:56.499356 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 07 10:27:56.499356 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 07 10:27:56.499356 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1a1d0d51-844a-4a45-9f11-71081578d56f in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 07 10:27:56.499356 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:27:56.499356 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:27:56.499356 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:27:56.499356 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:27:56.499356 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:27:56.499356 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:27:56.499356 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:27:56.499356 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:27:56.500513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:27:56.500513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:27:56.500513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 10:27:56.500513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 10:27:56.500513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 10:27:56.500513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 10:27:56.500513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 10:27:56.500513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 10:27:56.500513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 07 10:27:56.500513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 07 10:27:56.500513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 07 10:27:56.500513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 07 10:27:56.500513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1a1d0d51-844a-4a45-9f11-71081578d56f while it is in vm_state rescued Jul 07 10:27:56.500513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:27:56.500513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:27:56.500513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:27:56.500513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:27:56.500513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:27:56.500513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:27:56.501534 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:27:56.501534 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:27:56.501534 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1a1d0d51-844a-4a45-9f11-71081578d56f while it is in vm_state rescued Jul 07 10:27:56.501534 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:27:56.501534 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c2cd1c41-f475-4ed1-b744-681ca4cda46a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Returning 409 to user: Cannot 'attach_volume' instance 1a1d0d51-844a-4a45-9f11-71081578d56f while it is in vm_state rescued {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:27:56.501534 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c2cd1c41-f475-4ed1-b744-681ca4cda46a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "POST /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.117184 Jul 07 10:27:56.501534 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 116/248] 10.222.0.16 () {60 vars in 1322 bytes} [Thu Jul 7 10:27:56 2022] POST /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f/os-volume_attachments => generated 152 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 07 10:27:56.502673 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-197c8df9-05b9-4ff5-9d29-2b6670be01d5 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:56.503509 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-197c8df9-05b9-4ff5-9d29-2b6670be01d5 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] [instance: 03a8b2e2-624f-44b3-81fb-f7bf6d23634e] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:56.507260 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5f1765b7-4c32-4e93-95ea-748e2ea43e57 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:56.509547 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5f1765b7-4c32-4e93-95ea-748e2ea43e57 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:56.511226 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-197c8df9-05b9-4ff5-9d29-2b6670be01d5 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:56.512366 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-197c8df9-05b9-4ff5-9d29-2b6670be01d5 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:56.513321 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-197c8df9-05b9-4ff5-9d29-2b6670be01d5 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:56.513919 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-197c8df9-05b9-4ff5-9d29-2b6670be01d5 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:56.516996 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5f1765b7-4c32-4e93-95ea-748e2ea43e57 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:56.517554 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5f1765b7-4c32-4e93-95ea-748e2ea43e57 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:56.518338 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5f1765b7-4c32-4e93-95ea-748e2ea43e57 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:56.518770 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5f1765b7-4c32-4e93-95ea-748e2ea43e57 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:56.651644 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5f1765b7-4c32-4e93-95ea-748e2ea43e57 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:56.661753 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5f1765b7-4c32-4e93-95ea-748e2ea43e57 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6" status: 200 len: 1277 microversion: 2.1 time: 0.161760 Jul 07 10:27:56.676957 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 117/249] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:56 2022] GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 => generated 1277 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:56.702710 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-72e43666-43d9-4aad-86a1-d20bdf326eaa tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:27:56.703525 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-72e43666-43d9-4aad-86a1-d20bdf326eaa tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:56.714109 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-72e43666-43d9-4aad-86a1-d20bdf326eaa tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:56.714567 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-72e43666-43d9-4aad-86a1-d20bdf326eaa tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:56.715355 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-72e43666-43d9-4aad-86a1-d20bdf326eaa tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:56.715826 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-72e43666-43d9-4aad-86a1-d20bdf326eaa tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:56.764071 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-197c8df9-05b9-4ff5-9d29-2b6670be01d5 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9bcb3226f240a5951ab9971f6bb654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b2e4cb235e41da9ade19672bdd2e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:56.772084 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-197c8df9-05b9-4ff5-9d29-2b6670be01d5 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] 10.222.0.16 "GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e" status: 200 len: 1314 microversion: 2.1 time: 0.279036 Jul 07 10:27:56.775587 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 133/250] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:56 2022] GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:56.806290 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-72e43666-43d9-4aad-86a1-d20bdf326eaa tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "POST /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f/action" status: 202 len: 0 microversion: 2.1 time: 0.107534 Jul 07 10:27:56.810320 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 118/251] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Jul 7 10:27:56 2022] POST /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 10:27:56.815356 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-8bd89954-8539-4524-ae2e-33582d39f4eb tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:56.816004 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-8bd89954-8539-4524-ae2e-33582d39f4eb tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:56.823555 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8bd89954-8539-4524-ae2e-33582d39f4eb tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:56.824107 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8bd89954-8539-4524-ae2e-33582d39f4eb tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:56.824890 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8bd89954-8539-4524-ae2e-33582d39f4eb tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:56.825544 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8bd89954-8539-4524-ae2e-33582d39f4eb tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:56.914373 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8d95eef6-fa7f-44b1-9d53-d945dafb7869 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:56.915073 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8d95eef6-fa7f-44b1-9d53-d945dafb7869 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:56.930716 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8d95eef6-fa7f-44b1-9d53-d945dafb7869 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:56.931288 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8d95eef6-fa7f-44b1-9d53-d945dafb7869 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:56.933207 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8d95eef6-fa7f-44b1-9d53-d945dafb7869 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:56.933737 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8d95eef6-fa7f-44b1-9d53-d945dafb7869 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:57.076697 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8d95eef6-fa7f-44b1-9d53-d945dafb7869 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:57.086379 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8d95eef6-fa7f-44b1-9d53-d945dafb7869 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25" status: 200 len: 1266 microversion: 2.1 time: 0.176012 Jul 07 10:27:57.087089 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 119/252] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:56 2022] GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:57.107931 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-8bd89954-8539-4524-ae2e-33582d39f4eb tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:57.115712 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-8bd89954-8539-4524-ae2e-33582d39f4eb tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f" status: 200 len: 1510 microversion: 2.1 time: 0.303994 Jul 07 10:27:57.116837 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 134/253] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:56 2022] GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f => generated 1510 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:57.499311 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-98fa18b6-1d91-4d14-990a-b24db7b59977 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:57.500004 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-98fa18b6-1d91-4d14-990a-b24db7b59977 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:57.511635 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-98fa18b6-1d91-4d14-990a-b24db7b59977 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:57.526193 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-98fa18b6-1d91-4d14-990a-b24db7b59977 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:57.528228 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-98fa18b6-1d91-4d14-990a-b24db7b59977 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:57.531119 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-98fa18b6-1d91-4d14-990a-b24db7b59977 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:57.684388 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-c3fbede3-c7ed-42e9-b8c7-dfa84d67ee9f tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:57.685036 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-c3fbede3-c7ed-42e9-b8c7-dfa84d67ee9f tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:57.691451 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c3fbede3-c7ed-42e9-b8c7-dfa84d67ee9f tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:57.692024 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c3fbede3-c7ed-42e9-b8c7-dfa84d67ee9f tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:57.692866 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c3fbede3-c7ed-42e9-b8c7-dfa84d67ee9f tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:57.693451 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c3fbede3-c7ed-42e9-b8c7-dfa84d67ee9f tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:57.766701 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-c3fbede3-c7ed-42e9-b8c7-dfa84d67ee9f tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:57.775157 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-c3fbede3-c7ed-42e9-b8c7-dfa84d67ee9f tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6" status: 200 len: 1277 microversion: 2.1 time: 0.094725 Jul 07 10:27:57.784881 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 135/254] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:57 2022] GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 => generated 1277 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:27:57.793912 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-79fab7a2-d1cb-4978-bb4b-3a2ca5977ebe tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:57.794777 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-79fab7a2-d1cb-4978-bb4b-3a2ca5977ebe tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] [instance: 03a8b2e2-624f-44b3-81fb-f7bf6d23634e] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:57.802326 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-79fab7a2-d1cb-4978-bb4b-3a2ca5977ebe tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:57.803119 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-79fab7a2-d1cb-4978-bb4b-3a2ca5977ebe tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:57.803978 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-79fab7a2-d1cb-4978-bb4b-3a2ca5977ebe tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:57.805380 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-79fab7a2-d1cb-4978-bb4b-3a2ca5977ebe tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:57.996217 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-98fa18b6-1d91-4d14-990a-b24db7b59977 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:58.014069 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-98fa18b6-1d91-4d14-990a-b24db7b59977 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1359 microversion: 2.1 time: 0.520491 Jul 07 10:27:58.014963 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 120/255] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:57 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1359 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:58.050973 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-79fab7a2-d1cb-4978-bb4b-3a2ca5977ebe tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9bcb3226f240a5951ab9971f6bb654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b2e4cb235e41da9ade19672bdd2e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:58.060072 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-79fab7a2-d1cb-4978-bb4b-3a2ca5977ebe tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] 10.222.0.16 "GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e" status: 200 len: 1314 microversion: 2.1 time: 0.271812 Jul 07 10:27:58.060928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 136/256] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:57 2022] GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:58.105633 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-887f4820-bdaa-461f-b6d5-599b6451f1a9 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:58.106804 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-887f4820-bdaa-461f-b6d5-599b6451f1a9 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:58.115763 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-887f4820-bdaa-461f-b6d5-599b6451f1a9 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:58.116679 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-887f4820-bdaa-461f-b6d5-599b6451f1a9 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:58.120105 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-887f4820-bdaa-461f-b6d5-599b6451f1a9 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:58.120978 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-887f4820-bdaa-461f-b6d5-599b6451f1a9 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:58.137219 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-86f7fbe4-cadd-432a-99ef-51ba2ce39d97 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:58.137919 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-86f7fbe4-cadd-432a-99ef-51ba2ce39d97 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:58.154956 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-86f7fbe4-cadd-432a-99ef-51ba2ce39d97 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:58.155868 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-86f7fbe4-cadd-432a-99ef-51ba2ce39d97 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:58.156814 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-86f7fbe4-cadd-432a-99ef-51ba2ce39d97 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:58.157557 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-86f7fbe4-cadd-432a-99ef-51ba2ce39d97 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:58.265245 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-887f4820-bdaa-461f-b6d5-599b6451f1a9 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:58.280349 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-887f4820-bdaa-461f-b6d5-599b6451f1a9 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25" status: 200 len: 1272 microversion: 2.1 time: 0.180603 Jul 07 10:27:58.281362 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 121/257] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:58 2022] GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 => generated 1272 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:58.360943 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-7d999957-387b-4879-b8af-e1e5b39a5e0e req-18c6a774-61d9-46ca-9939-e193475c6d20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03a8b2e2-624f-44b3-81fb-f7bf6d23634e", "tag": "10ed8f63-fb1d-4905-927a-34b2f6274378"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:27:58.386945 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-7d999957-387b-4879-b8af-e1e5b39a5e0e req-18c6a774-61d9-46ca-9939-e193475c6d20 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:58.387400 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-7d999957-387b-4879-b8af-e1e5b39a5e0e req-18c6a774-61d9-46ca-9939-e193475c6d20 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:58.401422 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-7d999957-387b-4879-b8af-e1e5b39a5e0e req-18c6a774-61d9-46ca-9939-e193475c6d20 service nova] Creating event network-changed:10ed8f63-fb1d-4905-927a-34b2f6274378 for instance 03a8b2e2-624f-44b3-81fb-f7bf6d23634e on hv-cinder-82282 Jul 07 10:27:58.406630 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-7d999957-387b-4879-b8af-e1e5b39a5e0e req-18c6a774-61d9-46ca-9939-e193475c6d20 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061875 Jul 07 10:27:58.407584 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 122/258] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 10:27:58.423317 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-86f7fbe4-cadd-432a-99ef-51ba2ce39d97 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:58.434735 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-86f7fbe4-cadd-432a-99ef-51ba2ce39d97 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f" status: 200 len: 1510 microversion: 2.1 time: 0.303356 Jul 07 10:27:58.447144 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 137/259] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:58 2022] GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f => generated 1510 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:27:58.793981 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2482fd5d-9015-4292-852d-b9f210e372f3 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:58.796581 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-2482fd5d-9015-4292-852d-b9f210e372f3 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:58.813018 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2482fd5d-9015-4292-852d-b9f210e372f3 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:58.813926 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2482fd5d-9015-4292-852d-b9f210e372f3 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:58.814802 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2482fd5d-9015-4292-852d-b9f210e372f3 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:58.815454 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2482fd5d-9015-4292-852d-b9f210e372f3 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:59.030684 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-5964e158-82f9-4cbe-a640-20dfb4a547aa tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:59.031761 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-5964e158-82f9-4cbe-a640-20dfb4a547aa tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:59.037882 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5964e158-82f9-4cbe-a640-20dfb4a547aa tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:59.038658 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5964e158-82f9-4cbe-a640-20dfb4a547aa tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:59.040241 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5964e158-82f9-4cbe-a640-20dfb4a547aa tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:59.040892 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5964e158-82f9-4cbe-a640-20dfb4a547aa tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:59.269018 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-5964e158-82f9-4cbe-a640-20dfb4a547aa tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:59.281105 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-5964e158-82f9-4cbe-a640-20dfb4a547aa tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1359 microversion: 2.1 time: 0.253984 Jul 07 10:27:59.290338 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 138/260] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:59 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1359 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:59.290338 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-d2e999f1-ee41-428e-8166-4a7e00040492 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:59.290338 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-d2e999f1-ee41-428e-8166-4a7e00040492 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] [instance: 03a8b2e2-624f-44b3-81fb-f7bf6d23634e] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:59.298968 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d2e999f1-ee41-428e-8166-4a7e00040492 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:59.300079 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d2e999f1-ee41-428e-8166-4a7e00040492 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:59.301126 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d2e999f1-ee41-428e-8166-4a7e00040492 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:59.301663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d2e999f1-ee41-428e-8166-4a7e00040492 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:59.404930 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-2482fd5d-9015-4292-852d-b9f210e372f3 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:59.415977 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-2482fd5d-9015-4292-852d-b9f210e372f3 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6" status: 200 len: 1319 microversion: 2.1 time: 0.627319 Jul 07 10:27:59.425540 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 123/261] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:58 2022] GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 => generated 1319 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:59.430513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ce3e9d5d-8709-4d62-acd0-84a68adafb47 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:59.431140 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ce3e9d5d-8709-4d62-acd0-84a68adafb47 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:59.437394 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ce3e9d5d-8709-4d62-acd0-84a68adafb47 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:59.437854 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ce3e9d5d-8709-4d62-acd0-84a68adafb47 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:59.438640 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ce3e9d5d-8709-4d62-acd0-84a68adafb47 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:59.439079 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ce3e9d5d-8709-4d62-acd0-84a68adafb47 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:59.561675 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-d2e999f1-ee41-428e-8166-4a7e00040492 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9bcb3226f240a5951ab9971f6bb654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b2e4cb235e41da9ade19672bdd2e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:59.579996 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-d2e999f1-ee41-428e-8166-4a7e00040492 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] 10.222.0.16 "GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e" status: 200 len: 1314 microversion: 2.1 time: 0.296493 Jul 07 10:27:59.581263 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 139/262] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:59 2022] GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:59.589623 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-113d338d-5a6b-4c76-8cb8-41b9bdf045f9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:27:59.590374 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-113d338d-5a6b-4c76-8cb8-41b9bdf045f9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:27:59.604221 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-113d338d-5a6b-4c76-8cb8-41b9bdf045f9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:59.604928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-113d338d-5a6b-4c76-8cb8-41b9bdf045f9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:59.605769 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-113d338d-5a6b-4c76-8cb8-41b9bdf045f9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:59.606534 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-113d338d-5a6b-4c76-8cb8-41b9bdf045f9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:59.737738 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ce3e9d5d-8709-4d62-acd0-84a68adafb47 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:59.745676 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ce3e9d5d-8709-4d62-acd0-84a68adafb47 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25" status: 200 len: 1314 microversion: 2.1 time: 0.324453 Jul 07 10:27:59.746247 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 124/263] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:59 2022] GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:27:59.750592 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-c3e26f70-60fa-4282-a277-2ced5ea5da1b req-1e8d1c2c-42e9-4163-ae64-1c6d17ce323e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25", "tag": "1c55b0d4-9584-4b2b-8435-9d7ca3e79dbe"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:27:59.759615 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-c3e26f70-60fa-4282-a277-2ced5ea5da1b req-1e8d1c2c-42e9-4163-ae64-1c6d17ce323e service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:27:59.760084 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-c3e26f70-60fa-4282-a277-2ced5ea5da1b req-1e8d1c2c-42e9-4163-ae64-1c6d17ce323e service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:27:59.771451 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-c3e26f70-60fa-4282-a277-2ced5ea5da1b req-1e8d1c2c-42e9-4163-ae64-1c6d17ce323e service nova] Creating event network-changed:1c55b0d4-9584-4b2b-8435-9d7ca3e79dbe for instance f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 on hv-cinder-82282 Jul 07 10:27:59.776944 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-c3e26f70-60fa-4282-a277-2ced5ea5da1b req-1e8d1c2c-42e9-4163-ae64-1c6d17ce323e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029460 Jul 07 10:27:59.777498 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-113d338d-5a6b-4c76-8cb8-41b9bdf045f9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:27:59.777668 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 125/264] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:27:59.785767 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-113d338d-5a6b-4c76-8cb8-41b9bdf045f9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f" status: 200 len: 1510 microversion: 2.1 time: 0.203269 Jul 07 10:27:59.786392 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 140/265] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:27:59 2022] GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f => generated 1510 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:00.298497 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-f8c97101-b0b6-49f0-be2f-e6688004cf4d tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:00.299190 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-f8c97101-b0b6-49f0-be2f-e6688004cf4d tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:00.306057 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f8c97101-b0b6-49f0-be2f-e6688004cf4d tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:00.306504 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f8c97101-b0b6-49f0-be2f-e6688004cf4d tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:00.307263 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f8c97101-b0b6-49f0-be2f-e6688004cf4d tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:00.307700 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f8c97101-b0b6-49f0-be2f-e6688004cf4d tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:00.432204 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-17923641-58d3-4694-b902-d7571b0a4a12 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:00.432807 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-17923641-58d3-4694-b902-d7571b0a4a12 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:00.438716 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-17923641-58d3-4694-b902-d7571b0a4a12 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:00.439162 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-17923641-58d3-4694-b902-d7571b0a4a12 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:00.439955 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-17923641-58d3-4694-b902-d7571b0a4a12 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:00.442167 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-17923641-58d3-4694-b902-d7571b0a4a12 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:00.447597 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=100 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:28:00.456789 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f8c97101-b0b6-49f0-be2f-e6688004cf4d tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:00.466208 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-f8c97101-b0b6-49f0-be2f-e6688004cf4d tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1359 microversion: 2.1 time: 0.172370 Jul 07 10:28:00.467420 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 126/266] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:00 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:00.472048 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-4227d62b-565a-497c-b6b6-a6143056a663 req-e154207c-336c-41bd-8a6c-8794f68c451f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6", "tag": "9e332fd9-fdcf-495a-9546-8197da03d874"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:28:00.480497 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-4227d62b-565a-497c-b6b6-a6143056a663 req-e154207c-336c-41bd-8a6c-8794f68c451f service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:00.480935 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-4227d62b-565a-497c-b6b6-a6143056a663 req-e154207c-336c-41bd-8a6c-8794f68c451f service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:00.492495 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-4227d62b-565a-497c-b6b6-a6143056a663 req-e154207c-336c-41bd-8a6c-8794f68c451f service nova] Creating event network-changed:9e332fd9-fdcf-495a-9546-8197da03d874 for instance ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 on hv-cinder-82282 Jul 07 10:28:00.497320 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-4227d62b-565a-497c-b6b6-a6143056a663 req-e154207c-336c-41bd-8a6c-8794f68c451f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028547 Jul 07 10:28:00.497976 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 127/267] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:28:00.588427 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-17923641-58d3-4694-b902-d7571b0a4a12 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:00.595677 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-17923641-58d3-4694-b902-d7571b0a4a12 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6" status: 200 len: 1319 microversion: 2.1 time: 0.167366 Jul 07 10:28:00.596262 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 141/268] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:00 2022] GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:28:00.598756 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8f3df69a-7981-45db-a604-c1625645e186 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:00.599497 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8f3df69a-7981-45db-a604-c1625645e186 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] [instance: 03a8b2e2-624f-44b3-81fb-f7bf6d23634e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:00.606528 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8f3df69a-7981-45db-a604-c1625645e186 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:00.607027 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8f3df69a-7981-45db-a604-c1625645e186 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:00.607891 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8f3df69a-7981-45db-a604-c1625645e186 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:00.608335 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8f3df69a-7981-45db-a604-c1625645e186 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:00.745106 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8f3df69a-7981-45db-a604-c1625645e186 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9bcb3226f240a5951ab9971f6bb654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b2e4cb235e41da9ade19672bdd2e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:00.748968 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:28:00.755666 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8f3df69a-7981-45db-a604-c1625645e186 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] 10.222.0.16 "GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e" status: 200 len: 1314 microversion: 2.1 time: 0.161089 Jul 07 10:28:00.756484 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 128/269] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:00 2022] GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:28:00.763053 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-683f711b-916f-4ea0-84d2-b4fa2972c0fa tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:00.763768 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-683f711b-916f-4ea0-84d2-b4fa2972c0fa tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:00.770315 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-683f711b-916f-4ea0-84d2-b4fa2972c0fa tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:00.770925 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-683f711b-916f-4ea0-84d2-b4fa2972c0fa tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:00.771953 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-683f711b-916f-4ea0-84d2-b4fa2972c0fa tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:00.772540 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-683f711b-916f-4ea0-84d2-b4fa2972c0fa tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:00.803091 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-838f17c5-81a3-4d33-971b-33c5e0b25ee3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:00.805553 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-838f17c5-81a3-4d33-971b-33c5e0b25ee3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:00.816971 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-838f17c5-81a3-4d33-971b-33c5e0b25ee3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:00.817999 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-838f17c5-81a3-4d33-971b-33c5e0b25ee3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:00.819160 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-838f17c5-81a3-4d33-971b-33c5e0b25ee3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:00.819725 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-838f17c5-81a3-4d33-971b-33c5e0b25ee3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:00.934959 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-683f711b-916f-4ea0-84d2-b4fa2972c0fa tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:00.943331 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-683f711b-916f-4ea0-84d2-b4fa2972c0fa tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25" status: 200 len: 1314 microversion: 2.1 time: 0.184266 Jul 07 10:28:00.943984 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 142/270] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:00 2022] GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:00.950005 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-1b6a6de8-a448-4301-b9da-25413647ac0e req-bf51c0b5-6a17-4ede-a856-1f51246a5df5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca65cd17-61ba-4122-ba4b-59953053de02", "name": "network-vif-plugged", "status": "completed", "tag": "9e1716e6-ca2c-42e2-be39-5e2596494efc"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:28:00.957954 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-1b6a6de8-a448-4301-b9da-25413647ac0e req-bf51c0b5-6a17-4ede-a856-1f51246a5df5 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:00.958402 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-1b6a6de8-a448-4301-b9da-25413647ac0e req-bf51c0b5-6a17-4ede-a856-1f51246a5df5 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:00.970397 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-1b6a6de8-a448-4301-b9da-25413647ac0e req-bf51c0b5-6a17-4ede-a856-1f51246a5df5 service nova] Creating event network-vif-plugged:9e1716e6-ca2c-42e2-be39-5e2596494efc for instance ca65cd17-61ba-4122-ba4b-59953053de02 on hv-cinder-82282 Jul 07 10:28:00.975466 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-1b6a6de8-a448-4301-b9da-25413647ac0e req-bf51c0b5-6a17-4ede-a856-1f51246a5df5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030316 Jul 07 10:28:00.976371 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 143/271] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:28:00.986483 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-838f17c5-81a3-4d33-971b-33c5e0b25ee3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:00.993965 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-838f17c5-81a3-4d33-971b-33c5e0b25ee3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f" status: 200 len: 1510 microversion: 2.1 time: 0.195381 Jul 07 10:28:00.994743 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 129/272] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:00 2022] GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f => generated 1510 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:28:01.484264 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-7b478dc2-bf99-41ec-9e46-13fc4db6037e tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:01.484957 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-7b478dc2-bf99-41ec-9e46-13fc4db6037e tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:01.491060 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7b478dc2-bf99-41ec-9e46-13fc4db6037e tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:01.491514 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7b478dc2-bf99-41ec-9e46-13fc4db6037e tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:01.492895 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7b478dc2-bf99-41ec-9e46-13fc4db6037e tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:01.493344 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7b478dc2-bf99-41ec-9e46-13fc4db6037e tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:01.612972 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-35f893c5-9d37-41aa-bd1a-8438b8daaecb tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:01.613586 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-35f893c5-9d37-41aa-bd1a-8438b8daaecb tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:01.620636 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-35f893c5-9d37-41aa-bd1a-8438b8daaecb tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:01.621053 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-35f893c5-9d37-41aa-bd1a-8438b8daaecb tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:01.621826 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-35f893c5-9d37-41aa-bd1a-8438b8daaecb tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:01.622268 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-35f893c5-9d37-41aa-bd1a-8438b8daaecb tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:01.623228 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-7b478dc2-bf99-41ec-9e46-13fc4db6037e tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:01.631210 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-7b478dc2-bf99-41ec-9e46-13fc4db6037e tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1359 microversion: 2.1 time: 0.151346 Jul 07 10:28:01.631808 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 144/273] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:01 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:01.748316 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-35f893c5-9d37-41aa-bd1a-8438b8daaecb tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:01.755673 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-35f893c5-9d37-41aa-bd1a-8438b8daaecb tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6" status: 200 len: 1319 microversion: 2.1 time: 0.146596 Jul 07 10:28:01.756279 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 130/274] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:01 2022] GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:28:01.772849 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-b0608da7-f6ea-45eb-a5bc-a4657a29299f tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:01.773458 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-b0608da7-f6ea-45eb-a5bc-a4657a29299f tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] [instance: 03a8b2e2-624f-44b3-81fb-f7bf6d23634e] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:01.779867 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b0608da7-f6ea-45eb-a5bc-a4657a29299f tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:01.780321 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b0608da7-f6ea-45eb-a5bc-a4657a29299f tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:01.781078 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b0608da7-f6ea-45eb-a5bc-a4657a29299f tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:01.781544 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b0608da7-f6ea-45eb-a5bc-a4657a29299f tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:01.960646 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-91a911a5-1be7-4e9b-bd61-4acdd29a2e99 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:01.961756 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-91a911a5-1be7-4e9b-bd61-4acdd29a2e99 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:01.968178 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-91a911a5-1be7-4e9b-bd61-4acdd29a2e99 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:01.968363 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-91a911a5-1be7-4e9b-bd61-4acdd29a2e99 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:01.969035 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-91a911a5-1be7-4e9b-bd61-4acdd29a2e99 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:01.969468 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-91a911a5-1be7-4e9b-bd61-4acdd29a2e99 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:01.985631 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-b0608da7-f6ea-45eb-a5bc-a4657a29299f tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9bcb3226f240a5951ab9971f6bb654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b2e4cb235e41da9ade19672bdd2e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:01.995969 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-b0608da7-f6ea-45eb-a5bc-a4657a29299f tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] 10.222.0.16 "GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e" status: 200 len: 1314 microversion: 2.1 time: 0.226635 Jul 07 10:28:01.996875 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 145/275] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:01 2022] GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:02.012436 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-20922fb2-8346-4193-8f34-3025ac10691b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:02.013054 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-20922fb2-8346-4193-8f34-3025ac10691b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:02.029178 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-20922fb2-8346-4193-8f34-3025ac10691b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:02.029722 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-20922fb2-8346-4193-8f34-3025ac10691b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:02.030510 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-20922fb2-8346-4193-8f34-3025ac10691b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:02.030944 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-20922fb2-8346-4193-8f34-3025ac10691b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:02.441585 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-20922fb2-8346-4193-8f34-3025ac10691b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:02.452361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-20922fb2-8346-4193-8f34-3025ac10691b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f" status: 200 len: 1516 microversion: 2.1 time: 0.443624 Jul 07 10:28:02.453223 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 146/276] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:02 2022] GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f => generated 1516 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:02.488436 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-91a911a5-1be7-4e9b-bd61-4acdd29a2e99 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:02.497146 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-91a911a5-1be7-4e9b-bd61-4acdd29a2e99 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25" status: 200 len: 1314 microversion: 2.1 time: 0.540307 Jul 07 10:28:02.497850 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 131/277] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:01 2022] GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 => generated 1314 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:28:02.650967 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-d213cfd8-e4fd-417a-b584-fcc502229588 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:02.651930 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-d213cfd8-e4fd-417a-b584-fcc502229588 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:02.659319 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d213cfd8-e4fd-417a-b584-fcc502229588 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:02.659996 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d213cfd8-e4fd-417a-b584-fcc502229588 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:02.661055 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d213cfd8-e4fd-417a-b584-fcc502229588 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:02.661753 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d213cfd8-e4fd-417a-b584-fcc502229588 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:02.772542 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-88facea2-16e0-458b-8156-63a95ca5be3b tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:02.774298 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-88facea2-16e0-458b-8156-63a95ca5be3b tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:02.782010 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-88facea2-16e0-458b-8156-63a95ca5be3b tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:02.782662 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-88facea2-16e0-458b-8156-63a95ca5be3b tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:02.783637 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-88facea2-16e0-458b-8156-63a95ca5be3b tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:02.784266 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-88facea2-16e0-458b-8156-63a95ca5be3b tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:03.007094 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-d213cfd8-e4fd-417a-b584-fcc502229588 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:03.017435 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-d213cfd8-e4fd-417a-b584-fcc502229588 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1359 microversion: 2.1 time: 0.372473 Jul 07 10:28:03.018108 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 147/278] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:02 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1359 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:03.023937 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-1f7e203e-4af6-4b16-aaee-cd18d30aa0d7 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:03.024616 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-1f7e203e-4af6-4b16-aaee-cd18d30aa0d7 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] [instance: 03a8b2e2-624f-44b3-81fb-f7bf6d23634e] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:03.030748 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1f7e203e-4af6-4b16-aaee-cd18d30aa0d7 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:03.031299 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1f7e203e-4af6-4b16-aaee-cd18d30aa0d7 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:03.032207 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1f7e203e-4af6-4b16-aaee-cd18d30aa0d7 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:03.032773 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1f7e203e-4af6-4b16-aaee-cd18d30aa0d7 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:03.078563 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-88facea2-16e0-458b-8156-63a95ca5be3b tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:03.092742 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-88facea2-16e0-458b-8156-63a95ca5be3b tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6" status: 200 len: 1319 microversion: 2.1 time: 0.323988 Jul 07 10:28:03.093739 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 132/279] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:02 2022] GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 => generated 1319 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:28:03.178788 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-1f7e203e-4af6-4b16-aaee-cd18d30aa0d7 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9bcb3226f240a5951ab9971f6bb654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b2e4cb235e41da9ade19672bdd2e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:03.187098 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-1f7e203e-4af6-4b16-aaee-cd18d30aa0d7 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] 10.222.0.16 "GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e" status: 200 len: 1314 microversion: 2.1 time: 0.167956 Jul 07 10:28:03.187640 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 148/280] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:03 2022] GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:03.513939 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e5d3e827-2734-43e2-91c8-091d79582352 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:03.514562 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e5d3e827-2734-43e2-91c8-091d79582352 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:03.524208 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e5d3e827-2734-43e2-91c8-091d79582352 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:03.524656 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e5d3e827-2734-43e2-91c8-091d79582352 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:03.525417 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e5d3e827-2734-43e2-91c8-091d79582352 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:03.525847 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e5d3e827-2734-43e2-91c8-091d79582352 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:03.730281 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e5d3e827-2734-43e2-91c8-091d79582352 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:03.744179 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e5d3e827-2734-43e2-91c8-091d79582352 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25" status: 200 len: 1314 microversion: 2.1 time: 0.234042 Jul 07 10:28:03.753595 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 133/281] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:03 2022] GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:03.851711 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-b6486a69-b431-41d0-80ff-b3a56232f17d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Action: 'create', calling method: .version_select at 0x7f9e9e6d2430>, body: {"keypair": {"name": "tempest-keypair-1430372133", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLZAxTQX9FzG6GduX3uKa86PNb/LGK0B5d1bw23vngyvlDB74sky6fW4lQvU9APBUjSzD/0EWlmVdmp9XRWnBpJ54yLQ1bdhV9pcPTlGTunSJvP3F0nR0gU3+CgWTl7FA=="}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:28:03.875081 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-b6486a69-b431-41d0-80ff-b3a56232f17d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Getting quotas for project 0a883b49db0f4f32a32bf6d87e2f6104. Resources: {'key_pairs'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:28:03.879697 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-b6486a69-b431-41d0-80ff-b3a56232f17d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Getting quotas for user 92b758b22f054dd991e8af99354a134f and project 0a883b49db0f4f32a32bf6d87e2f6104. Resources: {'key_pairs'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:28:03.918900 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-b6486a69-b431-41d0-80ff-b3a56232f17d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.071226 Jul 07 10:28:03.920271 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 149/282] 10.222.0.16 () {60 vars in 1158 bytes} [Thu Jul 7 10:28:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:28:04.043947 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a21af2fd-b608-4184-9799-e6b39efbfee4 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:04.046130 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a21af2fd-b608-4184-9799-e6b39efbfee4 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:04.046679 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-c57177fe-9094-4698-9b5b-606cfaa77fe0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:28:04.055165 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a21af2fd-b608-4184-9799-e6b39efbfee4 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:04.055990 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a21af2fd-b608-4184-9799-e6b39efbfee4 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:04.056334 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c57177fe-9094-4698-9b5b-606cfaa77fe0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:04.056861 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c57177fe-9094-4698-9b5b-606cfaa77fe0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:04.057506 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a21af2fd-b608-4184-9799-e6b39efbfee4 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:04.058141 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a21af2fd-b608-4184-9799-e6b39efbfee4 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:04.126789 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-c57177fe-9094-4698-9b5b-606cfaa77fe0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Going to try to stop instance {{(pid=117646) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 07 10:28:04.186635 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-c57177fe-9094-4698-9b5b-606cfaa77fe0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "POST /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0/action" status: 202 len: 0 microversion: 2.1 time: 0.145566 Jul 07 10:28:04.188205 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 150/283] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Jul 7 10:28:04 2022] POST /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 07 10:28:04.194538 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-33e546dc-a31b-495e-822a-125ea2fa014b tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:04.195550 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-33e546dc-a31b-495e-822a-125ea2fa014b tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:04.203819 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-33e546dc-a31b-495e-822a-125ea2fa014b tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:04.204403 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-33e546dc-a31b-495e-822a-125ea2fa014b tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:04.205750 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-33e546dc-a31b-495e-822a-125ea2fa014b tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:04.206413 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-33e546dc-a31b-495e-822a-125ea2fa014b tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:04.230930 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a21af2fd-b608-4184-9799-e6b39efbfee4 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:04.240087 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a21af2fd-b608-4184-9799-e6b39efbfee4 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1359 microversion: 2.1 time: 0.201568 Jul 07 10:28:04.241022 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 134/284] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:04 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1359 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:04.245801 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-58d2c3e3-2cb9-4b29-abcc-e89603a81f8c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:04.246412 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-58d2c3e3-2cb9-4b29-abcc-e89603a81f8c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:04.252775 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-58d2c3e3-2cb9-4b29-abcc-e89603a81f8c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:04.253223 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-58d2c3e3-2cb9-4b29-abcc-e89603a81f8c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:04.253998 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-58d2c3e3-2cb9-4b29-abcc-e89603a81f8c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:04.254458 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-58d2c3e3-2cb9-4b29-abcc-e89603a81f8c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:04.419169 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-58d2c3e3-2cb9-4b29-abcc-e89603a81f8c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:04.427379 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-58d2c3e3-2cb9-4b29-abcc-e89603a81f8c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1724 microversion: 2.1 time: 0.185359 Jul 07 10:28:04.427977 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 135/285] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:04 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:04.432574 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e70c1d70-45c2-447a-a46e-c4eae47ca066 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:04.433422 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e70c1d70-45c2-447a-a46e-c4eae47ca066 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] [instance: 03a8b2e2-624f-44b3-81fb-f7bf6d23634e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:04.439242 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e70c1d70-45c2-447a-a46e-c4eae47ca066 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:04.439699 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e70c1d70-45c2-447a-a46e-c4eae47ca066 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:04.440495 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e70c1d70-45c2-447a-a46e-c4eae47ca066 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:04.440935 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e70c1d70-45c2-447a-a46e-c4eae47ca066 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:04.471650 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-33e546dc-a31b-495e-822a-125ea2fa014b tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:04.489640 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-33e546dc-a31b-495e-822a-125ea2fa014b tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6" status: 200 len: 1319 microversion: 2.1 time: 0.300233 Jul 07 10:28:04.493451 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 151/286] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:04 2022] GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:04.634456 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e70c1d70-45c2-447a-a46e-c4eae47ca066 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9bcb3226f240a5951ab9971f6bb654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b2e4cb235e41da9ade19672bdd2e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:04.642759 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e70c1d70-45c2-447a-a46e-c4eae47ca066 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] 10.222.0.16 "GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e" status: 200 len: 1314 microversion: 2.1 time: 0.213716 Jul 07 10:28:04.643345 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 136/287] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:04 2022] GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:04.762100 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-893da47e-d0ff-4b4e-82c1-847dcdb599d6 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:04.763082 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-893da47e-d0ff-4b4e-82c1-847dcdb599d6 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:04.769839 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-893da47e-d0ff-4b4e-82c1-847dcdb599d6 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:04.770688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-893da47e-d0ff-4b4e-82c1-847dcdb599d6 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:04.772063 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-893da47e-d0ff-4b4e-82c1-847dcdb599d6 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:04.772851 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-893da47e-d0ff-4b4e-82c1-847dcdb599d6 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:04.958768 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-893da47e-d0ff-4b4e-82c1-847dcdb599d6 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:04.980068 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-893da47e-d0ff-4b4e-82c1-847dcdb599d6 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25" status: 200 len: 1314 microversion: 2.1 time: 0.222746 Jul 07 10:28:05.000444 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 152/288] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:04 2022] GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:05.257311 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-7d1a90a6-e97d-4eea-b04b-6d1b058df5ca tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:05.258607 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-7d1a90a6-e97d-4eea-b04b-6d1b058df5ca tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:05.265029 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7d1a90a6-e97d-4eea-b04b-6d1b058df5ca tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:05.265670 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7d1a90a6-e97d-4eea-b04b-6d1b058df5ca tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:05.266688 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7d1a90a6-e97d-4eea-b04b-6d1b058df5ca tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:05.267210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7d1a90a6-e97d-4eea-b04b-6d1b058df5ca tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:05.445363 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-1e370c68-1bbb-44ca-bf65-1717ade8b4b2 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:05.445976 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-1e370c68-1bbb-44ca-bf65-1717ade8b4b2 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:05.456701 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1e370c68-1bbb-44ca-bf65-1717ade8b4b2 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:05.457371 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1e370c68-1bbb-44ca-bf65-1717ade8b4b2 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:05.458813 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1e370c68-1bbb-44ca-bf65-1717ade8b4b2 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:05.459412 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1e370c68-1bbb-44ca-bf65-1717ade8b4b2 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:05.616146 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-1e370c68-1bbb-44ca-bf65-1717ade8b4b2 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:05.625228 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-1e370c68-1bbb-44ca-bf65-1717ade8b4b2 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1724 microversion: 2.1 time: 0.184148 Jul 07 10:28:05.625933 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 153/289] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:05 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:05.639861 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a60473ed-d578-4831-b0a3-7fa0114cdbc0 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:05.640272 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-a60473ed-d578-4831-b0a3-7fa0114cdbc0 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:05.642483 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-7d1a90a6-e97d-4eea-b04b-6d1b058df5ca tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:05.646565 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a60473ed-d578-4831-b0a3-7fa0114cdbc0 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:05.647016 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a60473ed-d578-4831-b0a3-7fa0114cdbc0 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:05.647982 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a60473ed-d578-4831-b0a3-7fa0114cdbc0 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:05.649132 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a60473ed-d578-4831-b0a3-7fa0114cdbc0 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:05.651494 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-7d1a90a6-e97d-4eea-b04b-6d1b058df5ca tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1548 microversion: 2.1 time: 0.398448 Jul 07 10:28:05.676492 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 137/290] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:05 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1548 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:05.684440 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-3550e4e4-8525-44bd-ab1f-73768a8364de tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:05.690545 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-3550e4e4-8525-44bd-ab1f-73768a8364de tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:05.699927 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3550e4e4-8525-44bd-ab1f-73768a8364de tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:05.700943 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3550e4e4-8525-44bd-ab1f-73768a8364de tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:05.702065 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3550e4e4-8525-44bd-ab1f-73768a8364de tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:05.702741 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3550e4e4-8525-44bd-ab1f-73768a8364de tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:05.747496 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell0:SELECT=4 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:28:05.815911 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-a60473ed-d578-4831-b0a3-7fa0114cdbc0 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:05.826312 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-a60473ed-d578-4831-b0a3-7fa0114cdbc0 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6" status: 200 len: 1319 microversion: 2.1 time: 0.196277 Jul 07 10:28:05.827454 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 154/291] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:05 2022] GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:05.832832 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-660d93a1-006d-4d09-8c56-66408788cacd tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:05.833786 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-660d93a1-006d-4d09-8c56-66408788cacd tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] [instance: 03a8b2e2-624f-44b3-81fb-f7bf6d23634e] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:05.842067 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-660d93a1-006d-4d09-8c56-66408788cacd tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:05.842512 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-660d93a1-006d-4d09-8c56-66408788cacd tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:05.843280 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-660d93a1-006d-4d09-8c56-66408788cacd tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:05.843787 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-660d93a1-006d-4d09-8c56-66408788cacd tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:05.955182 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-3550e4e4-8525-44bd-ab1f-73768a8364de tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:05.963220 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-3550e4e4-8525-44bd-ab1f-73768a8364de tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1548 microversion: 2.1 time: 0.285110 Jul 07 10:28:05.963820 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 138/292] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:05 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1548 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:05.980017 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ca3961b7-6b7e-48e4-9d94-d47f59234771 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:05.983522 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ca3961b7-6b7e-48e4-9d94-d47f59234771 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:05.984547 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ca3961b7-6b7e-48e4-9d94-d47f59234771 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Searching by: {'deleted': False, 'project_id': '5a2481546251413fb65aaed9e3f131e2'} {{(pid=117647) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 07 10:28:05.991888 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ca3961b7-6b7e-48e4-9d94-d47f59234771 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:05.992356 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ca3961b7-6b7e-48e4-9d94-d47f59234771 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:05.993172 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ca3961b7-6b7e-48e4-9d94-d47f59234771 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:05.993603 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ca3961b7-6b7e-48e4-9d94-d47f59234771 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:06.039711 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-660d93a1-006d-4d09-8c56-66408788cacd tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9bcb3226f240a5951ab9971f6bb654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b2e4cb235e41da9ade19672bdd2e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:06.048418 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-660d93a1-006d-4d09-8c56-66408788cacd tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] 10.222.0.16 "GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e" status: 200 len: 1314 microversion: 2.1 time: 0.219609 Jul 07 10:28:06.049410 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 155/293] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:05 2022] GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:06.053887 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-abde0621-4620-4a07-824f-bcda9451ced1 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:06.054557 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-abde0621-4620-4a07-824f-bcda9451ced1 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:06.056301 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=93 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:28:06.063598 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-abde0621-4620-4a07-824f-bcda9451ced1 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:06.064379 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-abde0621-4620-4a07-824f-bcda9451ced1 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:06.065316 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-abde0621-4620-4a07-824f-bcda9451ced1 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:06.065900 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-abde0621-4620-4a07-824f-bcda9451ced1 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:06.095861 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.multi_cell_list [None req-ca3961b7-6b7e-48e4-9d94-d47f59234771 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117647) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 07 10:28:06.192091 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ca3961b7-6b7e-48e4-9d94-d47f59234771 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.216230 Jul 07 10:28:06.192694 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 139/294] 10.222.0.16 () {58 vars in 1124 bytes} [Thu Jul 7 10:28:05 2022] GET /compute/v2.1/servers => generated 343 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 10:28:06.198205 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-aef360cd-d0cb-4511-a751-d3ee2684eb75 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1646017355", "imageRef": "1c96509d-f65f-42b0-94b3-6fc590a93508", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03eb7d11-d380-46df-8615-998b46a27260"}], "security_groups": [{"name": "tempest-securitygroup--2125336384"}], "key_name": "tempest-keypair-1430372133", "user_data": "}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:28:06.285532 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-abde0621-4620-4a07-824f-bcda9451ced1 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:06.294285 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-abde0621-4620-4a07-824f-bcda9451ced1 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25" status: 200 len: 1314 microversion: 2.1 time: 0.243288 Jul 07 10:28:06.302913 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 156/295] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:06 2022] GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:06.307227 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.network.neutron [None req-aef360cd-d0cb-4511-a751-d3ee2684eb75 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] validate_networks() for [('03eb7d11-d380-46df-8615-998b46a27260', None, None, None, None, None)] {{(pid=117647) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 10:28:06.308887 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-458a7afb-3370-4345-a9f4-bb52ba98025c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:06.309842 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-458a7afb-3370-4345-a9f4-bb52ba98025c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:06.316678 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-458a7afb-3370-4345-a9f4-bb52ba98025c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:06.317208 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-458a7afb-3370-4345-a9f4-bb52ba98025c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:06.318094 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-458a7afb-3370-4345-a9f4-bb52ba98025c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:06.318597 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-458a7afb-3370-4345-a9f4-bb52ba98025c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:06.538336 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-458a7afb-3370-4345-a9f4-bb52ba98025c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:06.546548 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-458a7afb-3370-4345-a9f4-bb52ba98025c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1548 microversion: 2.1 time: 0.241949 Jul 07 10:28:06.547665 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 157/296] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:06 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1548 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:06.646236 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-55eba592-dcab-4ba1-a1dc-55be9067adde tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:06.647783 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-55eba592-dcab-4ba1-a1dc-55be9067adde tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:06.656141 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-55eba592-dcab-4ba1-a1dc-55be9067adde tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:06.657883 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-55eba592-dcab-4ba1-a1dc-55be9067adde tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:06.659462 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-55eba592-dcab-4ba1-a1dc-55be9067adde tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:06.660414 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-55eba592-dcab-4ba1-a1dc-55be9067adde tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:06.701198 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:28:06.966562 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-55eba592-dcab-4ba1-a1dc-55be9067adde tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:06.975765 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-55eba592-dcab-4ba1-a1dc-55be9067adde tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1724 microversion: 2.1 time: 0.337139 Jul 07 10:28:06.985841 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 158/297] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:06 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1724 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:06.995201 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-d544e8fc-8206-4c8c-ae2c-b98d70aed210 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:06.995856 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-d544e8fc-8206-4c8c-ae2c-b98d70aed210 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:07.002217 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d544e8fc-8206-4c8c-ae2c-b98d70aed210 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:07.002719 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d544e8fc-8206-4c8c-ae2c-b98d70aed210 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:07.003493 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d544e8fc-8206-4c8c-ae2c-b98d70aed210 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:07.004734 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d544e8fc-8206-4c8c-ae2c-b98d70aed210 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:07.093409 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-aef360cd-d0cb-4511-a751-d3ee2684eb75 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Flavor limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 10:28:07.093826 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-aef360cd-d0cb-4511-a751-d3ee2684eb75 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Image limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 10:28:07.095270 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-aef360cd-d0cb-4511-a751-d3ee2684eb75 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Flavor pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 10:28:07.096556 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-aef360cd-d0cb-4511-a751-d3ee2684eb75 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Image pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 10:28:07.097211 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-aef360cd-d0cb-4511-a751-d3ee2684eb75 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 10:28:07.111984 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-aef360cd-d0cb-4511-a751-d3ee2684eb75 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:07.112750 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-aef360cd-d0cb-4511-a751-d3ee2684eb75 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:07.113868 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-aef360cd-d0cb-4511-a751-d3ee2684eb75 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:07.114555 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-aef360cd-d0cb-4511-a751-d3ee2684eb75 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:07.141913 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-aef360cd-d0cb-4511-a751-d3ee2684eb75 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Getting quotas for project 0a883b49db0f4f32a32bf6d87e2f6104. Resources: {'cores', 'ram', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:28:07.147022 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-aef360cd-d0cb-4511-a751-d3ee2684eb75 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Getting quotas for user 92b758b22f054dd991e8af99354a134f and project 0a883b49db0f4f32a32bf6d87e2f6104. Resources: {'cores', 'ram', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:28:07.160474 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-aef360cd-d0cb-4511-a751-d3ee2684eb75 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Going to run 1 instances... {{(pid=117647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 10:28:07.163535 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-aef360cd-d0cb-4511-a751-d3ee2684eb75 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c96509d-f65f-42b0-94b3-6fc590a93508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 10:28:07.226108 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-aef360cd-d0cb-4511-a751-d3ee2684eb75 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.032174 Jul 07 10:28:07.227572 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 140/298] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jul 7 10:28:06 2022] POST /compute/v2.1/servers => generated 409 bytes in 1034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 10:28:07.237123 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-768ce7f5-80ad-4d21-8cdf-2b3f63b89c9c tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:07.238067 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-768ce7f5-80ad-4d21-8cdf-2b3f63b89c9c tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] [instance: 03a8b2e2-624f-44b3-81fb-f7bf6d23634e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:07.246348 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-768ce7f5-80ad-4d21-8cdf-2b3f63b89c9c tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:07.246941 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-768ce7f5-80ad-4d21-8cdf-2b3f63b89c9c tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:07.247987 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-768ce7f5-80ad-4d21-8cdf-2b3f63b89c9c tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:07.248805 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-768ce7f5-80ad-4d21-8cdf-2b3f63b89c9c tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:07.416496 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-d544e8fc-8206-4c8c-ae2c-b98d70aed210 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:07.426580 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-d544e8fc-8206-4c8c-ae2c-b98d70aed210 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6" status: 200 len: 1319 microversion: 2.1 time: 0.446393 Jul 07 10:28:07.427163 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 159/299] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:06 2022] GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 => generated 1319 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:07.435673 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-513e16e8-7a61-4a97-a40c-d7ccd4660ec3 req-76265b95-a87b-40d7-8dde-fa9b51a9a78a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03a8b2e2-624f-44b3-81fb-f7bf6d23634e", "name": "network-vif-plugged", "status": "completed", "tag": "10ed8f63-fb1d-4905-927a-34b2f6274378"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:28:07.453985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-513e16e8-7a61-4a97-a40c-d7ccd4660ec3 req-76265b95-a87b-40d7-8dde-fa9b51a9a78a service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:07.454615 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-513e16e8-7a61-4a97-a40c-d7ccd4660ec3 req-76265b95-a87b-40d7-8dde-fa9b51a9a78a service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:07.480521 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-513e16e8-7a61-4a97-a40c-d7ccd4660ec3 req-76265b95-a87b-40d7-8dde-fa9b51a9a78a service nova] Creating event network-vif-plugged:10ed8f63-fb1d-4905-927a-34b2f6274378 for instance 03a8b2e2-624f-44b3-81fb-f7bf6d23634e on hv-cinder-82282 Jul 07 10:28:07.499012 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-513e16e8-7a61-4a97-a40c-d7ccd4660ec3 req-76265b95-a87b-40d7-8dde-fa9b51a9a78a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070566 Jul 07 10:28:07.499616 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 160/300] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:28:07.504701 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-61c70777-c04a-4071-9084-a0407d92d96d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:07.505394 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-61c70777-c04a-4071-9084-a0407d92d96d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:07.566955 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-768ce7f5-80ad-4d21-8cdf-2b3f63b89c9c tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9bcb3226f240a5951ab9971f6bb654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b2e4cb235e41da9ade19672bdd2e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:07.575836 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-768ce7f5-80ad-4d21-8cdf-2b3f63b89c9c tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] 10.222.0.16 "GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e" status: 200 len: 1314 microversion: 2.1 time: 0.346728 Jul 07 10:28:07.586821 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 141/301] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:07 2022] GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:07.594650 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-49075cc9-7602-48ce-8e06-7961c50ec232 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:07.611731 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-49075cc9-7602-48ce-8e06-7961c50ec232 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:07.620569 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-49075cc9-7602-48ce-8e06-7961c50ec232 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:07.624947 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-49075cc9-7602-48ce-8e06-7961c50ec232 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:07.628806 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-49075cc9-7602-48ce-8e06-7961c50ec232 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:07.629276 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-49075cc9-7602-48ce-8e06-7961c50ec232 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:07.631158 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-61c70777-c04a-4071-9084-a0407d92d96d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:07.640679 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-61c70777-c04a-4071-9084-a0407d92d96d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1246 microversion: 2.1 time: 0.139835 Jul 07 10:28:07.641601 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 161/302] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:07 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1246 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:07.865590 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-49075cc9-7602-48ce-8e06-7961c50ec232 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:07.883084 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-49075cc9-7602-48ce-8e06-7961c50ec232 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25" status: 200 len: 1314 microversion: 2.1 time: 0.291533 Jul 07 10:28:07.893351 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 142/303] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:07 2022] GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:07.994025 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-4bf2cf7c-7bf3-4588-a1a1-2e7fde89a448 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:07.994670 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-4bf2cf7c-7bf3-4588-a1a1-2e7fde89a448 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:08.019023 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4bf2cf7c-7bf3-4588-a1a1-2e7fde89a448 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:08.019800 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4bf2cf7c-7bf3-4588-a1a1-2e7fde89a448 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:08.020545 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4bf2cf7c-7bf3-4588-a1a1-2e7fde89a448 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:08.020992 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4bf2cf7c-7bf3-4588-a1a1-2e7fde89a448 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:08.287166 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-f6de36f1-2dd1-418e-9c8f-28a50cfc7399 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62ef1a09-5890-4886-9619-410794272f77"}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:28:08.289188 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-f6de36f1-2dd1-418e-9c8f-28a50cfc7399 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:08.297758 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f6de36f1-2dd1-418e-9c8f-28a50cfc7399 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:08.298684 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f6de36f1-2dd1-418e-9c8f-28a50cfc7399 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:08.299684 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f6de36f1-2dd1-418e-9c8f-28a50cfc7399 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:08.300258 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f6de36f1-2dd1-418e-9c8f-28a50cfc7399 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:08.346413 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-4bf2cf7c-7bf3-4588-a1a1-2e7fde89a448 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:08.355830 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-4bf2cf7c-7bf3-4588-a1a1-2e7fde89a448 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1724 microversion: 2.1 time: 0.366166 Jul 07 10:28:08.357111 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 162/304] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:07 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1724 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:08.444448 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-827a5113-ac63-4fe8-9c34-161e1930a158 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:08.445331 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-827a5113-ac63-4fe8-9c34-161e1930a158 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:08.451310 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-827a5113-ac63-4fe8-9c34-161e1930a158 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:08.451784 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-827a5113-ac63-4fe8-9c34-161e1930a158 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:08.452549 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-827a5113-ac63-4fe8-9c34-161e1930a158 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:08.452989 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-827a5113-ac63-4fe8-9c34-161e1930a158 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:08.703167 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-827a5113-ac63-4fe8-9c34-161e1930a158 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:08.711332 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-827a5113-ac63-4fe8-9c34-161e1930a158 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6" status: 200 len: 1319 microversion: 2.1 time: 0.270788 Jul 07 10:28:08.712130 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 163/305] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:08 2022] GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:28:08.721543 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-5bf6871d-9285-425a-bc8d-c2e5c174381f tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:08.722418 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-5bf6871d-9285-425a-bc8d-c2e5c174381f tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] [instance: 03a8b2e2-624f-44b3-81fb-f7bf6d23634e] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:08.729661 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5bf6871d-9285-425a-bc8d-c2e5c174381f tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:08.731423 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5bf6871d-9285-425a-bc8d-c2e5c174381f tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:08.732491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5bf6871d-9285-425a-bc8d-c2e5c174381f tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:08.733084 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5bf6871d-9285-425a-bc8d-c2e5c174381f tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:08.957938 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-5bf6871d-9285-425a-bc8d-c2e5c174381f tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9bcb3226f240a5951ab9971f6bb654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b2e4cb235e41da9ade19672bdd2e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:08.966201 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-5bf6871d-9285-425a-bc8d-c2e5c174381f tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] 10.222.0.16 "GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e" status: 200 len: 1314 microversion: 2.1 time: 0.253256 Jul 07 10:28:08.966768 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 164/306] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:08 2022] GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:08.971696 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-40f88bbd-4a70-48bd-aef2-ecfbe3282453 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:08.972715 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-40f88bbd-4a70-48bd-aef2-ecfbe3282453 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:08.980417 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-40f88bbd-4a70-48bd-aef2-ecfbe3282453 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:08.981087 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-40f88bbd-4a70-48bd-aef2-ecfbe3282453 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:08.982045 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-40f88bbd-4a70-48bd-aef2-ecfbe3282453 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:08.982676 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-40f88bbd-4a70-48bd-aef2-ecfbe3282453 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:09.089696 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-40f88bbd-4a70-48bd-aef2-ecfbe3282453 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:09.099514 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-40f88bbd-4a70-48bd-aef2-ecfbe3282453 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1298 microversion: 2.1 time: 0.131235 Jul 07 10:28:09.100452 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 165/307] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:08 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1298 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:09.107472 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-837a52bb-5d96-4764-a68f-da158d02730d tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:09.108334 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-837a52bb-5d96-4764-a68f-da158d02730d tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:09.116154 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-837a52bb-5d96-4764-a68f-da158d02730d tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:09.120023 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-837a52bb-5d96-4764-a68f-da158d02730d tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:09.122052 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-837a52bb-5d96-4764-a68f-da158d02730d tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:09.124478 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-837a52bb-5d96-4764-a68f-da158d02730d tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:09.286044 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-f6de36f1-2dd1-418e-9c8f-28a50cfc7399 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "POST /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.002449 Jul 07 10:28:09.286997 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 143/308] 10.222.0.16 () {60 vars in 1322 bytes} [Thu Jul 7 10:28:08 2022] POST /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02/os-volume_attachments => generated 194 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:28:09.375202 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-26b3bd6c-9a1c-4d76-9973-ebb8cf298286 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:09.375938 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-26b3bd6c-9a1c-4d76-9973-ebb8cf298286 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:09.384325 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-26b3bd6c-9a1c-4d76-9973-ebb8cf298286 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:09.384771 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-26b3bd6c-9a1c-4d76-9973-ebb8cf298286 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:09.385760 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-26b3bd6c-9a1c-4d76-9973-ebb8cf298286 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:09.386196 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-26b3bd6c-9a1c-4d76-9973-ebb8cf298286 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:09.404950 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:28:09.594439 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-26b3bd6c-9a1c-4d76-9973-ebb8cf298286 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:09.606504 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-26b3bd6c-9a1c-4d76-9973-ebb8cf298286 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1724 microversion: 2.1 time: 0.234093 Jul 07 10:28:09.620239 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 144/309] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:09 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:09.635003 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-837a52bb-5d96-4764-a68f-da158d02730d tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:09.653863 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-837a52bb-5d96-4764-a68f-da158d02730d tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25" status: 200 len: 1314 microversion: 2.1 time: 0.551781 Jul 07 10:28:09.664539 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 166/310] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:09 2022] GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 => generated 1314 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:09.732478 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-21e2a7eb-b3bb-46ea-b631-f047c3a09d54 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:09.733183 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-21e2a7eb-b3bb-46ea-b631-f047c3a09d54 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:09.742338 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-21e2a7eb-b3bb-46ea-b631-f047c3a09d54 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:09.742834 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-21e2a7eb-b3bb-46ea-b631-f047c3a09d54 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:09.743699 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-21e2a7eb-b3bb-46ea-b631-f047c3a09d54 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:09.744256 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-21e2a7eb-b3bb-46ea-b631-f047c3a09d54 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:09.983185 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-da5b8007-88d9-4f74-aa78-0bdf765fa76b tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:09.984203 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-da5b8007-88d9-4f74-aa78-0bdf765fa76b tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] [instance: 03a8b2e2-624f-44b3-81fb-f7bf6d23634e] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:09.988873 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-21e2a7eb-b3bb-46ea-b631-f047c3a09d54 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:10.003891 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-21e2a7eb-b3bb-46ea-b631-f047c3a09d54 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6" status: 200 len: 1319 microversion: 2.1 time: 0.276561 Jul 07 10:28:10.004319 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-da5b8007-88d9-4f74-aa78-0bdf765fa76b tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:10.013437 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 145/311] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:09 2022] GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:10.013639 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-da5b8007-88d9-4f74-aa78-0bdf765fa76b tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:10.013639 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-da5b8007-88d9-4f74-aa78-0bdf765fa76b tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:10.013639 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-da5b8007-88d9-4f74-aa78-0bdf765fa76b tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:10.123135 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4291133e-2964-4815-96e7-2002d53519fd tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:10.125211 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-4291133e-2964-4815-96e7-2002d53519fd tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:10.136705 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4291133e-2964-4815-96e7-2002d53519fd tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:10.137565 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4291133e-2964-4815-96e7-2002d53519fd tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:10.139081 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4291133e-2964-4815-96e7-2002d53519fd tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:10.139863 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4291133e-2964-4815-96e7-2002d53519fd tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:10.274526 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-da5b8007-88d9-4f74-aa78-0bdf765fa76b tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9bcb3226f240a5951ab9971f6bb654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b2e4cb235e41da9ade19672bdd2e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:10.288515 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-da5b8007-88d9-4f74-aa78-0bdf765fa76b tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] 10.222.0.16 "GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e" status: 200 len: 1464 microversion: 2.1 time: 0.309347 Jul 07 10:28:10.291090 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-4291133e-2964-4815-96e7-2002d53519fd tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:10.310029 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-4291133e-2964-4815-96e7-2002d53519fd tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1304 microversion: 2.1 time: 0.196666 Jul 07 10:28:10.311126 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 146/313] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:10 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1304 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:10.326001 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 167/313] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:09 2022] GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e => generated 1464 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:10.355378 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-06648889-08cc-4285-ac1c-998e153ee942 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:10.356016 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-06648889-08cc-4285-ac1c-998e153ee942 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] [instance: 03a8b2e2-624f-44b3-81fb-f7bf6d23634e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:10.366113 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-06648889-08cc-4285-ac1c-998e153ee942 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:10.368966 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-06648889-08cc-4285-ac1c-998e153ee942 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:10.369866 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-06648889-08cc-4285-ac1c-998e153ee942 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:10.370376 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-06648889-08cc-4285-ac1c-998e153ee942 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:10.432309 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-06648889-08cc-4285-ac1c-998e153ee942 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] [instance: 03a8b2e2-624f-44b3-81fb-f7bf6d23634e] Going to try to terminate instance {{(pid=117647) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 10:28:10.548471 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-06648889-08cc-4285-ac1c-998e153ee942 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] 10.222.0.16 "DELETE /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e" status: 204 len: 0 microversion: 2.1 time: 0.197278 Jul 07 10:28:10.549510 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 147/314] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jul 7 10:28:10 2022] DELETE /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 10:28:10.559029 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-c7501d93-be28-49d5-a045-12d76c091fb7 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:10.559761 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-c7501d93-be28-49d5-a045-12d76c091fb7 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] [instance: 03a8b2e2-624f-44b3-81fb-f7bf6d23634e] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:10.567071 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c7501d93-be28-49d5-a045-12d76c091fb7 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:10.568046 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c7501d93-be28-49d5-a045-12d76c091fb7 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:10.569159 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c7501d93-be28-49d5-a045-12d76c091fb7 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:10.570514 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c7501d93-be28-49d5-a045-12d76c091fb7 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:10.628974 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ca8f3a20-29a6-4ea2-905e-01a33551e705 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:10.630050 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ca8f3a20-29a6-4ea2-905e-01a33551e705 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:10.649796 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ca8f3a20-29a6-4ea2-905e-01a33551e705 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:10.650832 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ca8f3a20-29a6-4ea2-905e-01a33551e705 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:10.651763 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ca8f3a20-29a6-4ea2-905e-01a33551e705 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:10.654788 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ca8f3a20-29a6-4ea2-905e-01a33551e705 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:10.862965 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-c7501d93-be28-49d5-a045-12d76c091fb7 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9bcb3226f240a5951ab9971f6bb654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b2e4cb235e41da9ade19672bdd2e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:10.879293 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-c7501d93-be28-49d5-a045-12d76c091fb7 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] 10.222.0.16 "GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e" status: 200 len: 1470 microversion: 2.1 time: 0.325148 Jul 07 10:28:10.881614 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 168/315] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:10 2022] GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e => generated 1470 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:10.900607 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-da873ca1-3975-40ed-9cb2-10ff10b3f070 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:10.901975 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-da873ca1-3975-40ed-9cb2-10ff10b3f070 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:10.911400 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-da873ca1-3975-40ed-9cb2-10ff10b3f070 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:10.913643 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-da873ca1-3975-40ed-9cb2-10ff10b3f070 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:10.916513 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-da873ca1-3975-40ed-9cb2-10ff10b3f070 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:10.919391 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-da873ca1-3975-40ed-9cb2-10ff10b3f070 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:11.052389 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ca8f3a20-29a6-4ea2-905e-01a33551e705 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:11.067086 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ca8f3a20-29a6-4ea2-905e-01a33551e705 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1724 microversion: 2.1 time: 0.443340 Jul 07 10:28:11.068048 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 148/316] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:10 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1724 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:28:11.080339 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-694b47ed-31d8-4f3d-8270-bc5fa0a9267c tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:11.083122 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-694b47ed-31d8-4f3d-8270-bc5fa0a9267c tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:11.092264 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-694b47ed-31d8-4f3d-8270-bc5fa0a9267c tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:11.092777 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-694b47ed-31d8-4f3d-8270-bc5fa0a9267c tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:11.094225 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-694b47ed-31d8-4f3d-8270-bc5fa0a9267c tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:11.094878 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-694b47ed-31d8-4f3d-8270-bc5fa0a9267c tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:11.214881 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-da873ca1-3975-40ed-9cb2-10ff10b3f070 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:11.232098 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-da873ca1-3975-40ed-9cb2-10ff10b3f070 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25" status: 200 len: 1314 microversion: 2.1 time: 0.345887 Jul 07 10:28:11.232847 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 169/317] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:10 2022] GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:11.262883 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-694b47ed-31d8-4f3d-8270-bc5fa0a9267c tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:11.270782 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-694b47ed-31d8-4f3d-8270-bc5fa0a9267c tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6" status: 200 len: 1319 microversion: 2.1 time: 0.201677 Jul 07 10:28:11.271674 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 149/318] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:11 2022] GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:11.330574 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-c15332f3-80cb-4d03-9445-e9db1ea6176d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:11.331511 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-c15332f3-80cb-4d03-9445-e9db1ea6176d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:11.344421 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c15332f3-80cb-4d03-9445-e9db1ea6176d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:11.345118 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c15332f3-80cb-4d03-9445-e9db1ea6176d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:11.346209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c15332f3-80cb-4d03-9445-e9db1ea6176d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:11.346825 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c15332f3-80cb-4d03-9445-e9db1ea6176d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:11.567696 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-c15332f3-80cb-4d03-9445-e9db1ea6176d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:11.578092 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-c15332f3-80cb-4d03-9445-e9db1ea6176d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1372 microversion: 2.1 time: 0.251913 Jul 07 10:28:11.588568 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 170/319] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:11 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1372 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:11.899311 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-eca40429-9c70-4832-b46f-304af8843567 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:11.899981 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-eca40429-9c70-4832-b46f-304af8843567 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] [instance: 03a8b2e2-624f-44b3-81fb-f7bf6d23634e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:11.902390 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:28:11.909878 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-eca40429-9c70-4832-b46f-304af8843567 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:11.910535 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-eca40429-9c70-4832-b46f-304af8843567 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:11.911977 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-eca40429-9c70-4832-b46f-304af8843567 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:11.912725 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-eca40429-9c70-4832-b46f-304af8843567 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:12.086744 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-8faeb93e-85d0-4454-b051-4a19968daab0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:12.087943 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-8faeb93e-85d0-4454-b051-4a19968daab0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:12.097507 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8faeb93e-85d0-4454-b051-4a19968daab0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:12.097959 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8faeb93e-85d0-4454-b051-4a19968daab0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:12.098760 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8faeb93e-85d0-4454-b051-4a19968daab0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:12.099193 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8faeb93e-85d0-4454-b051-4a19968daab0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:12.338505 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-8faeb93e-85d0-4454-b051-4a19968daab0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:12.353255 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-8faeb93e-85d0-4454-b051-4a19968daab0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1724 microversion: 2.1 time: 0.271406 Jul 07 10:28:12.355224 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 171/320] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:12 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1724 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:12.361073 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-eca40429-9c70-4832-b46f-304af8843567 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9bcb3226f240a5951ab9971f6bb654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b2e4cb235e41da9ade19672bdd2e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:12.369487 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-eca40429-9c70-4832-b46f-304af8843567 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] 10.222.0.16 "GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e" status: 200 len: 1470 microversion: 2.1 time: 0.474844 Jul 07 10:28:12.370065 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 150/321] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:11 2022] GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e => generated 1470 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:12.378399 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-14ae080d-f673-461e-8f88-89dbed7ef7ca tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:12.379329 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-72d74c63-9001-4735-b327-82d2bdf90265 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:12.380109 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-72d74c63-9001-4735-b327-82d2bdf90265 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:12.384792 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-14ae080d-f673-461e-8f88-89dbed7ef7ca tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:12.391439 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-72d74c63-9001-4735-b327-82d2bdf90265 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:12.394955 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-14ae080d-f673-461e-8f88-89dbed7ef7ca tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:12.395621 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-72d74c63-9001-4735-b327-82d2bdf90265 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:12.396588 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-72d74c63-9001-4735-b327-82d2bdf90265 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:12.397198 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-72d74c63-9001-4735-b327-82d2bdf90265 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:12.402146 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-14ae080d-f673-461e-8f88-89dbed7ef7ca tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:12.413536 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-14ae080d-f673-461e-8f88-89dbed7ef7ca tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:12.414013 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-14ae080d-f673-461e-8f88-89dbed7ef7ca tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:12.605798 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-72d74c63-9001-4735-b327-82d2bdf90265 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:12.638253 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-72d74c63-9001-4735-b327-82d2bdf90265 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25" status: 200 len: 1314 microversion: 2.1 time: 0.281373 Jul 07 10:28:12.639530 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 172/322] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:12 2022] GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:12.646064 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-2e5e3c48-f405-4388-aa5a-c04ab189388c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:12.647151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-2e5e3c48-f405-4388-aa5a-c04ab189388c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:12.654310 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2e5e3c48-f405-4388-aa5a-c04ab189388c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:12.655763 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2e5e3c48-f405-4388-aa5a-c04ab189388c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:12.656807 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2e5e3c48-f405-4388-aa5a-c04ab189388c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:12.657640 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2e5e3c48-f405-4388-aa5a-c04ab189388c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:12.806845 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-14ae080d-f673-461e-8f88-89dbed7ef7ca tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:12.836678 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-14ae080d-f673-461e-8f88-89dbed7ef7ca tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6" status: 200 len: 1319 microversion: 2.1 time: 0.461550 Jul 07 10:28:12.846884 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 151/323] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:12 2022] GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 => generated 1319 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:12.873257 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-2e5e3c48-f405-4388-aa5a-c04ab189388c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:12.881090 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-2e5e3c48-f405-4388-aa5a-c04ab189388c tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1372 microversion: 2.1 time: 0.239150 Jul 07 10:28:12.881674 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 173/324] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:12 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1372 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:13.165295 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-963b7727-564b-42a3-b2ba-a0b8198a8fc3 req-f1131ac6-399c-4720-be9a-a62b82835242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25", "name": "network-vif-plugged", "status": "completed", "tag": "1c55b0d4-9584-4b2b-8435-9d7ca3e79dbe"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:28:13.190612 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-963b7727-564b-42a3-b2ba-a0b8198a8fc3 req-f1131ac6-399c-4720-be9a-a62b82835242 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:13.191424 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-963b7727-564b-42a3-b2ba-a0b8198a8fc3 req-f1131ac6-399c-4720-be9a-a62b82835242 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:13.224566 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-963b7727-564b-42a3-b2ba-a0b8198a8fc3 req-f1131ac6-399c-4720-be9a-a62b82835242 service nova] Creating event network-vif-plugged:1c55b0d4-9584-4b2b-8435-9d7ca3e79dbe for instance f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 on hv-cinder-82282 Jul 07 10:28:13.237270 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-963b7727-564b-42a3-b2ba-a0b8198a8fc3 req-f1131ac6-399c-4720-be9a-a62b82835242 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075246 Jul 07 10:28:13.240493 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 152/325] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:28:13.371843 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-6aad649c-704a-4bc8-9a11-171c017ae779 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:13.372471 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-6aad649c-704a-4bc8-9a11-171c017ae779 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:13.382346 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6aad649c-704a-4bc8-9a11-171c017ae779 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:13.382807 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6aad649c-704a-4bc8-9a11-171c017ae779 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:13.388003 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6aad649c-704a-4bc8-9a11-171c017ae779 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:13.389517 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6aad649c-704a-4bc8-9a11-171c017ae779 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:13.390719 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-7d962301-bb93-4ca7-898a-2aff48b047b9 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:13.394693 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-7d962301-bb93-4ca7-898a-2aff48b047b9 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] [instance: 03a8b2e2-624f-44b3-81fb-f7bf6d23634e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:13.418164 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7d962301-bb93-4ca7-898a-2aff48b047b9 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:13.418617 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7d962301-bb93-4ca7-898a-2aff48b047b9 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:13.423439 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7d962301-bb93-4ca7-898a-2aff48b047b9 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:13.429778 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7d962301-bb93-4ca7-898a-2aff48b047b9 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:13.602235 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-7d962301-bb93-4ca7-898a-2aff48b047b9 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9bcb3226f240a5951ab9971f6bb654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b2e4cb235e41da9ade19672bdd2e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:13.619929 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-7d962301-bb93-4ca7-898a-2aff48b047b9 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] 10.222.0.16 "GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e" status: 200 len: 1428 microversion: 2.1 time: 0.236488 Jul 07 10:28:13.631958 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 153/326] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:13 2022] GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e => generated 1428 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:13.652042 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-514798ce-4274-45e8-b303-0cf499e66aa2 req-2cb4a89a-8d25-48ac-8594-e7e1caa6930d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03a8b2e2-624f-44b3-81fb-f7bf6d23634e", "name": "network-vif-deleted", "tag": "10ed8f63-fb1d-4905-927a-34b2f6274378"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:28:13.685976 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-514798ce-4274-45e8-b303-0cf499e66aa2 req-2cb4a89a-8d25-48ac-8594-e7e1caa6930d service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:13.687587 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-514798ce-4274-45e8-b303-0cf499e66aa2 req-2cb4a89a-8d25-48ac-8594-e7e1caa6930d service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:13.726455 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-514798ce-4274-45e8-b303-0cf499e66aa2 req-2cb4a89a-8d25-48ac-8594-e7e1caa6930d service nova] Creating event network-vif-deleted:10ed8f63-fb1d-4905-927a-34b2f6274378 for instance 03a8b2e2-624f-44b3-81fb-f7bf6d23634e on hv-cinder-82282 Jul 07 10:28:13.741043 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-514798ce-4274-45e8-b303-0cf499e66aa2 req-2cb4a89a-8d25-48ac-8594-e7e1caa6930d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105177 Jul 07 10:28:13.748864 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 154/327] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:28:13.768527 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-30de7a1b-964b-4d5e-8993-1c3a7faca2e6 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:13.769633 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-30de7a1b-964b-4d5e-8993-1c3a7faca2e6 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:13.777319 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-30de7a1b-964b-4d5e-8993-1c3a7faca2e6 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:13.778059 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-30de7a1b-964b-4d5e-8993-1c3a7faca2e6 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:13.779510 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-30de7a1b-964b-4d5e-8993-1c3a7faca2e6 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:13.780153 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-30de7a1b-964b-4d5e-8993-1c3a7faca2e6 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:14.006966 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-6aad649c-704a-4bc8-9a11-171c017ae779 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:14.018994 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-6aad649c-704a-4bc8-9a11-171c017ae779 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1724 microversion: 2.1 time: 0.651155 Jul 07 10:28:14.020286 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 174/328] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:13 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1724 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:14.026118 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-6933c038-848d-4d0b-b8e0-a4e8283fcb77 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:14.027866 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-30de7a1b-964b-4d5e-8993-1c3a7faca2e6 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:14.037466 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-6933c038-848d-4d0b-b8e0-a4e8283fcb77 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:14.045592 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6933c038-848d-4d0b-b8e0-a4e8283fcb77 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:14.046244 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6933c038-848d-4d0b-b8e0-a4e8283fcb77 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:14.047115 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6933c038-848d-4d0b-b8e0-a4e8283fcb77 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:14.047540 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6933c038-848d-4d0b-b8e0-a4e8283fcb77 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:14.052963 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-30de7a1b-964b-4d5e-8993-1c3a7faca2e6 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25" status: 200 len: 1314 microversion: 2.1 time: 0.301625 Jul 07 10:28:14.053733 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 155/329] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:13 2022] GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:14.066931 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-abbfff7a-6ba5-4ba8-9c14-9ad14d33efc1 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:14.067664 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-abbfff7a-6ba5-4ba8-9c14-9ad14d33efc1 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:14.085225 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-abbfff7a-6ba5-4ba8-9c14-9ad14d33efc1 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:14.086061 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-abbfff7a-6ba5-4ba8-9c14-9ad14d33efc1 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:14.087249 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-abbfff7a-6ba5-4ba8-9c14-9ad14d33efc1 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:14.088056 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-abbfff7a-6ba5-4ba8-9c14-9ad14d33efc1 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:14.242250 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-6933c038-848d-4d0b-b8e0-a4e8283fcb77 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:14.252498 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-6933c038-848d-4d0b-b8e0-a4e8283fcb77 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6" status: 200 len: 1319 microversion: 2.1 time: 0.230789 Jul 07 10:28:14.253451 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 175/330] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:14 2022] GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:14.639376 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-5787a274-4195-4cfc-a83c-35cc1e928c57 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:14.640062 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-5787a274-4195-4cfc-a83c-35cc1e928c57 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] [instance: 03a8b2e2-624f-44b3-81fb-f7bf6d23634e] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:14.646019 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5787a274-4195-4cfc-a83c-35cc1e928c57 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:14.646747 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5787a274-4195-4cfc-a83c-35cc1e928c57 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:14.648054 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5787a274-4195-4cfc-a83c-35cc1e928c57 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:14.648715 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5787a274-4195-4cfc-a83c-35cc1e928c57 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:14.662947 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.wsgi [None req-5787a274-4195-4cfc-a83c-35cc1e928c57 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] HTTP exception thrown: Instance 03a8b2e2-624f-44b3-81fb-f7bf6d23634e could not be found. Jul 07 10:28:14.664800 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-5787a274-4195-4cfc-a83c-35cc1e928c57 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Request method failure captured: Jul 07 10:28:14.664800 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e HTTP/1.1 Jul 07 10:28:14.664800 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:28:14.664800 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:28:14.664800 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:28:14.664800 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 0 Jul 07 10:28:14.664800 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:28:14.664800 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:28:14.664800 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:28:14.664800 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:28:14.664800 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrUZrK2iDpviV0XutmR7CVdnM-Ah_fIqxgHq7JoyGrnYdJ4pNgvg0rjhS7vA9YirjCnyFVBXsdTmT-VlRFTk4nBMcdeGpQS4ksgAbb8Wzx1Km_uwMAqd4S7mobWGcsOtgidMDAASXbE-de-0jroaCmIecRQ0uQGBLu6DOZhD1B1bTLE Jul 07 10:28:14.664800 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:28:14.664800 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:28:14.664800 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:28:14.664800 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:28:14.664800 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:28:14.664800 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:28:14.664800 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: 71b2e4cb235e41da9ade19672bdd2e4d Jul 07 10:28:14.664800 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-VolumesNegativeTest-1606547262 Jul 07 10:28:14.664800 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:28:14.664800 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:28:14.666095 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71b2e4cb235e41da9ade19672bdd2e4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/71b2e4cb235e41da9ade19672bdd2e4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71b2e4cb235e41da9ade19672bdd2e4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_71b2e4cb235e41da9ade19672bdd2e4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:28:14.666095 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-VolumesNegativeTest-1606547262 Jul 07 10:28:14.666095 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: 71b2e4cb235e41da9ade19672bdd2e4d Jul 07 10:28:14.666095 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-VolumesNegativeTest-1606547262 Jul 07 10:28:14.666095 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-VolumesNegativeTest-1606547262-project Jul 07 10:28:14.666095 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:28:14.666095 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:28:14.666095 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: ee9bcb3226f240a5951ab9971f6bb654 Jul 07 10:28:14.666095 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-VolumesNegativeTest-1606547262-project Jul 07 10:28:14.666095 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: > Jul 07 10:28:14.666095 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Instance 03a8b2e2-624f-44b3-81fb-f7bf6d23634e could not be found. Jul 07 10:28:14.666095 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'id': '03a8b2e2-624f-44b3-81fb-f7bf6d23634e'} Jul 07 10:28:14.666786 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:28:14.666786 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:28:14.666786 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:28:14.666786 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:28:14.666786 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:28:14.666786 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:28:14.666786 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:28:14.666786 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:28:14.666786 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:28:14.666786 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:28:14.666786 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03a8b2e2-624f-44b3-81fb-f7bf6d23634e could not be found. Jul 07 10:28:14.666786 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:28:14.666786 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:28:14.666786 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:28:14.666786 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:28:14.666786 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:28:14.666786 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:28:14.666786 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:28:14.666786 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:28:14.666786 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:28:14.667990 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:28:14.667990 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:28:14.667990 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:28:14.667990 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:28:14.667990 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:28:14.667990 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:28:14.667990 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:28:14.667990 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03a8b2e2-624f-44b3-81fb-f7bf6d23634e could not be found. Jul 07 10:28:14.667990 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:28:14.667990 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:28:14.667990 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:28:14.667990 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:28:14.667990 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:28:14.667990 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:28:14.667990 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:28:14.667990 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:28:14.667990 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03a8b2e2-624f-44b3-81fb-f7bf6d23634e could not be found. Jul 07 10:28:14.667990 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:28:14.668969 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-5787a274-4195-4cfc-a83c-35cc1e928c57 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] Returning 404 to user: Instance 03a8b2e2-624f-44b3-81fb-f7bf6d23634e could not be found. {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:28:14.668969 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-5787a274-4195-4cfc-a83c-35cc1e928c57 tempest-VolumesNegativeTest-1606547262 tempest-VolumesNegativeTest-1606547262-project] 10.222.0.16 "GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e" status: 404 len: 111 microversion: 2.1 time: 0.031212 Jul 07 10:28:14.672645 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 176/331] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:14 2022] GET /compute/v2.1/servers/03a8b2e2-624f-44b3-81fb-f7bf6d23634e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:28:14.673252 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-abbfff7a-6ba5-4ba8-9c14-9ad14d33efc1 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:14.681677 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-abbfff7a-6ba5-4ba8-9c14-9ad14d33efc1 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1372 microversion: 2.1 time: 0.626302 Jul 07 10:28:14.691235 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 156/332] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:14 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1372 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:15.044196 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-c4c4c5f1-4a94-4f7a-b981-b9f683507552 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:15.045156 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-c4c4c5f1-4a94-4f7a-b981-b9f683507552 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:15.051980 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c4c4c5f1-4a94-4f7a-b981-b9f683507552 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:15.052670 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c4c4c5f1-4a94-4f7a-b981-b9f683507552 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:15.053780 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c4c4c5f1-4a94-4f7a-b981-b9f683507552 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:15.055027 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c4c4c5f1-4a94-4f7a-b981-b9f683507552 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:15.074585 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-bf4d9658-6e28-4798-8f91-d37c26ed6abf tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:15.076060 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-bf4d9658-6e28-4798-8f91-d37c26ed6abf tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:15.083896 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bf4d9658-6e28-4798-8f91-d37c26ed6abf tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:15.084715 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bf4d9658-6e28-4798-8f91-d37c26ed6abf tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:15.085937 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bf4d9658-6e28-4798-8f91-d37c26ed6abf tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:15.086536 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bf4d9658-6e28-4798-8f91-d37c26ed6abf tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:15.105389 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=100 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:28:15.301936 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-c4c4c5f1-4a94-4f7a-b981-b9f683507552 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:15.315010 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-c4c4c5f1-4a94-4f7a-b981-b9f683507552 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1724 microversion: 2.1 time: 0.280052 Jul 07 10:28:15.316201 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 177/333] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:15 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1724 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:15.324113 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-50a1b605-6693-460c-b9a4-c840fb05c6e6 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:15.324992 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-50a1b605-6693-460c-b9a4-c840fb05c6e6 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:15.332832 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-50a1b605-6693-460c-b9a4-c840fb05c6e6 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:15.333573 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-50a1b605-6693-460c-b9a4-c840fb05c6e6 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:15.334441 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-50a1b605-6693-460c-b9a4-c840fb05c6e6 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:15.334996 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-50a1b605-6693-460c-b9a4-c840fb05c6e6 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:15.561196 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-bf4d9658-6e28-4798-8f91-d37c26ed6abf tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:15.573049 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-bf4d9658-6e28-4798-8f91-d37c26ed6abf tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25" status: 200 len: 1314 microversion: 2.1 time: 0.506300 Jul 07 10:28:15.573636 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 157/334] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:15 2022] GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 => generated 1314 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:15.579700 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-03f01e71-bd00-419c-823c-ba1df91e9755 req-49de61b6-79de-4f2b-af3b-cfcffb2251a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6", "name": "network-vif-plugged", "status": "completed", "tag": "9e332fd9-fdcf-495a-9546-8197da03d874"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:28:15.596258 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-03f01e71-bd00-419c-823c-ba1df91e9755 req-49de61b6-79de-4f2b-af3b-cfcffb2251a9 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:15.600025 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-03f01e71-bd00-419c-823c-ba1df91e9755 req-49de61b6-79de-4f2b-af3b-cfcffb2251a9 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:15.617574 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-03f01e71-bd00-419c-823c-ba1df91e9755 req-49de61b6-79de-4f2b-af3b-cfcffb2251a9 service nova] Creating event network-vif-plugged:9e332fd9-fdcf-495a-9546-8197da03d874 for instance ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 on hv-cinder-82282 Jul 07 10:28:15.620745 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-50a1b605-6693-460c-b9a4-c840fb05c6e6 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:15.622744 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-03f01e71-bd00-419c-823c-ba1df91e9755 req-49de61b6-79de-4f2b-af3b-cfcffb2251a9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047763 Jul 07 10:28:15.623955 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 158/335] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:28:15.636972 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-50a1b605-6693-460c-b9a4-c840fb05c6e6 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6" status: 200 len: 1319 microversion: 2.1 time: 0.319364 Jul 07 10:28:15.638189 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 178/336] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:15 2022] GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:15.699462 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-319178cb-532a-4563-a0a8-bfaca29da411 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:15.700263 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-319178cb-532a-4563-a0a8-bfaca29da411 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:15.717641 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-319178cb-532a-4563-a0a8-bfaca29da411 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:15.718099 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-319178cb-532a-4563-a0a8-bfaca29da411 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:15.718875 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-319178cb-532a-4563-a0a8-bfaca29da411 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:15.719312 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-319178cb-532a-4563-a0a8-bfaca29da411 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:15.805123 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-c9bbf6e9-b1c9-4c9f-ab77-036cec258c17 req-a53fa2e6-92a9-4975-b989-c30f403cc759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5080ca5c-bf77-4305-877b-c992e9248b40", "tag": "f2d0b2c3-ea20-4eea-87fe-434f9d0de45e"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:28:15.816773 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-c9bbf6e9-b1c9-4c9f-ab77-036cec258c17 req-a53fa2e6-92a9-4975-b989-c30f403cc759 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:15.817284 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-c9bbf6e9-b1c9-4c9f-ab77-036cec258c17 req-a53fa2e6-92a9-4975-b989-c30f403cc759 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:15.832019 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-c9bbf6e9-b1c9-4c9f-ab77-036cec258c17 req-a53fa2e6-92a9-4975-b989-c30f403cc759 service nova] Creating event network-changed:f2d0b2c3-ea20-4eea-87fe-434f9d0de45e for instance 5080ca5c-bf77-4305-877b-c992e9248b40 on hv-cinder-82282 Jul 07 10:28:15.839166 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-c9bbf6e9-b1c9-4c9f-ab77-036cec258c17 req-a53fa2e6-92a9-4975-b989-c30f403cc759 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039543 Jul 07 10:28:15.840380 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 179/337] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:28:16.341238 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-faf6e87d-e55c-4766-a32f-20fa21ae01f8 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:16.342391 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-faf6e87d-e55c-4766-a32f-20fa21ae01f8 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:16.369005 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-faf6e87d-e55c-4766-a32f-20fa21ae01f8 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:16.369735 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-faf6e87d-e55c-4766-a32f-20fa21ae01f8 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:16.373191 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-faf6e87d-e55c-4766-a32f-20fa21ae01f8 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:16.374812 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-faf6e87d-e55c-4766-a32f-20fa21ae01f8 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:16.448104 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-319178cb-532a-4563-a0a8-bfaca29da411 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:16.467370 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-319178cb-532a-4563-a0a8-bfaca29da411 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1372 microversion: 2.1 time: 0.772281 Jul 07 10:28:16.469317 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 159/338] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:15 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1372 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:16.593658 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-93dbeb0f-2b9b-4bdd-9e0f-0b1b4af4d260 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:16.594812 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-93dbeb0f-2b9b-4bdd-9e0f-0b1b4af4d260 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:16.636239 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-93dbeb0f-2b9b-4bdd-9e0f-0b1b4af4d260 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:16.638329 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-93dbeb0f-2b9b-4bdd-9e0f-0b1b4af4d260 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:16.639171 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-93dbeb0f-2b9b-4bdd-9e0f-0b1b4af4d260 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:16.652546 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-93dbeb0f-2b9b-4bdd-9e0f-0b1b4af4d260 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:16.690357 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-faf6e87d-e55c-4766-a32f-20fa21ae01f8 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:16.701445 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-faf6e87d-e55c-4766-a32f-20fa21ae01f8 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1724 microversion: 2.1 time: 0.369211 Jul 07 10:28:16.716976 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 180/339] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:16 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1724 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:16.729002 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-ab75d751-7e97-4a25-82c5-38949265eb6a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:16.733946 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-ab75d751-7e97-4a25-82c5-38949265eb6a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:16.747953 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ab75d751-7e97-4a25-82c5-38949265eb6a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:16.748418 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ab75d751-7e97-4a25-82c5-38949265eb6a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:16.751596 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ab75d751-7e97-4a25-82c5-38949265eb6a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:16.754462 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ab75d751-7e97-4a25-82c5-38949265eb6a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:17.052835 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-ab75d751-7e97-4a25-82c5-38949265eb6a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:17.061105 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-ab75d751-7e97-4a25-82c5-38949265eb6a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6" status: 200 len: 1319 microversion: 2.1 time: 0.342501 Jul 07 10:28:17.061693 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 181/340] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:16 2022] GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 => generated 1319 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:17.128977 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-93dbeb0f-2b9b-4bdd-9e0f-0b1b4af4d260 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:17.131334 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=4 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:28:17.144224 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-93dbeb0f-2b9b-4bdd-9e0f-0b1b4af4d260 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25" status: 200 len: 1498 microversion: 2.1 time: 0.557276 Jul 07 10:28:17.148504 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 160/341] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:16 2022] GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 => generated 1498 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:28:17.485657 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-ef2dd63f-c133-4740-8a0d-dd62c69e6e88 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:17.486268 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-ef2dd63f-c133-4740-8a0d-dd62c69e6e88 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:17.514727 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ef2dd63f-c133-4740-8a0d-dd62c69e6e88 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:17.515241 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ef2dd63f-c133-4740-8a0d-dd62c69e6e88 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:17.516084 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ef2dd63f-c133-4740-8a0d-dd62c69e6e88 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:17.516533 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ef2dd63f-c133-4740-8a0d-dd62c69e6e88 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:17.636493 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell0:SELECT=22 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:28:17.723042 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-fc7c2532-ed7d-4bc8-8e3e-d56f4a4d9886 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:17.725012 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-fc7c2532-ed7d-4bc8-8e3e-d56f4a4d9886 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:17.731390 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=6 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:28:17.738179 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fc7c2532-ed7d-4bc8-8e3e-d56f4a4d9886 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:17.742625 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fc7c2532-ed7d-4bc8-8e3e-d56f4a4d9886 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:17.745123 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fc7c2532-ed7d-4bc8-8e3e-d56f4a4d9886 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:17.745789 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fc7c2532-ed7d-4bc8-8e3e-d56f4a4d9886 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:17.778387 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-ef2dd63f-c133-4740-8a0d-dd62c69e6e88 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:17.789781 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-ef2dd63f-c133-4740-8a0d-dd62c69e6e88 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1372 microversion: 2.1 time: 0.307614 Jul 07 10:28:17.791228 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 182/342] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:17 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1372 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:17.792390 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:28:17.932730 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-8115ffe1-0ba1-4cc1-beca-03262f5e809f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:17.933246 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-8115ffe1-0ba1-4cc1-beca-03262f5e809f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:17.943709 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8115ffe1-0ba1-4cc1-beca-03262f5e809f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:17.950313 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8115ffe1-0ba1-4cc1-beca-03262f5e809f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:17.957723 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8115ffe1-0ba1-4cc1-beca-03262f5e809f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:17.959719 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8115ffe1-0ba1-4cc1-beca-03262f5e809f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:18.040505 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-8115ffe1-0ba1-4cc1-beca-03262f5e809f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25] Going to try to terminate instance {{(pid=117646) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 10:28:18.226071 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-8115ffe1-0ba1-4cc1-beca-03262f5e809f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25" status: 204 len: 0 microversion: 2.1 time: 0.298998 Jul 07 10:28:18.226710 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 183/343] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jul 7 10:28:17 2022] DELETE /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 07 10:28:18.236323 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-450029e2-6498-41c3-893a-e324d5161768 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:18.237307 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-450029e2-6498-41c3-893a-e324d5161768 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:18.245692 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-450029e2-6498-41c3-893a-e324d5161768 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:18.246503 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-450029e2-6498-41c3-893a-e324d5161768 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:18.247965 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-450029e2-6498-41c3-893a-e324d5161768 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:18.248666 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-450029e2-6498-41c3-893a-e324d5161768 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:18.580931 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-450029e2-6498-41c3-893a-e324d5161768 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:18.589601 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-450029e2-6498-41c3-893a-e324d5161768 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6" status: 200 len: 1319 microversion: 2.1 time: 0.358709 Jul 07 10:28:18.590583 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 184/344] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:18 2022] GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:18.595510 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-b93462c4-1925-40eb-a8cc-e289f52ed2d4 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:18.596587 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-b93462c4-1925-40eb-a8cc-e289f52ed2d4 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:18.603013 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b93462c4-1925-40eb-a8cc-e289f52ed2d4 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:18.603542 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b93462c4-1925-40eb-a8cc-e289f52ed2d4 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:18.604437 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b93462c4-1925-40eb-a8cc-e289f52ed2d4 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:18.605053 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b93462c4-1925-40eb-a8cc-e289f52ed2d4 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:18.738997 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-fc7c2532-ed7d-4bc8-8e3e-d56f4a4d9886 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:18.753325 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-fc7c2532-ed7d-4bc8-8e3e-d56f4a4d9886 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1724 microversion: 2.1 time: 1.034476 Jul 07 10:28:18.766943 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 161/345] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:17 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1724 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:18.789996 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-b93462c4-1925-40eb-a8cc-e289f52ed2d4 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:18.801430 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-b93462c4-1925-40eb-a8cc-e289f52ed2d4 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25" status: 200 len: 1504 microversion: 2.1 time: 0.209563 Jul 07 10:28:18.802844 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 185/346] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:18 2022] GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 => generated 1504 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:18.818670 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1ffed0be-8c8b-438b-8441-8c29e7288caa tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:18.819284 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1ffed0be-8c8b-438b-8441-8c29e7288caa tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:18.825998 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1ffed0be-8c8b-438b-8441-8c29e7288caa tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:18.826511 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1ffed0be-8c8b-438b-8441-8c29e7288caa tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:18.827217 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1ffed0be-8c8b-438b-8441-8c29e7288caa tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:18.827652 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1ffed0be-8c8b-438b-8441-8c29e7288caa tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:19.096481 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-1ffed0be-8c8b-438b-8441-8c29e7288caa tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:19.108287 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1ffed0be-8c8b-438b-8441-8c29e7288caa tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1372 microversion: 2.1 time: 0.305671 Jul 07 10:28:19.109391 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 162/347] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:18 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1372 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:19.605976 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-3330c702-2fb7-4f86-8104-5bc23af9d78e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:19.606592 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-3330c702-2fb7-4f86-8104-5bc23af9d78e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:19.612724 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3330c702-2fb7-4f86-8104-5bc23af9d78e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:19.613187 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3330c702-2fb7-4f86-8104-5bc23af9d78e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:19.613966 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3330c702-2fb7-4f86-8104-5bc23af9d78e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:19.614409 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3330c702-2fb7-4f86-8104-5bc23af9d78e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:19.774833 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-3330c702-2fb7-4f86-8104-5bc23af9d78e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:19.776837 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5708aaea-7b88-4016-9baa-f3a586206315 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:19.777983 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5708aaea-7b88-4016-9baa-f3a586206315 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:19.784703 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5708aaea-7b88-4016-9baa-f3a586206315 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:19.785428 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5708aaea-7b88-4016-9baa-f3a586206315 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:19.785892 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-3330c702-2fb7-4f86-8104-5bc23af9d78e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6" status: 200 len: 1319 microversion: 2.1 time: 0.183244 Jul 07 10:28:19.786596 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5708aaea-7b88-4016-9baa-f3a586206315 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:19.787218 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5708aaea-7b88-4016-9baa-f3a586206315 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:19.796454 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 186/348] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:19 2022] GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:19.823313 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-6229f0d6-9659-4a89-9942-bd0f1963dfef tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:19.824813 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-6229f0d6-9659-4a89-9942-bd0f1963dfef tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:19.835693 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6229f0d6-9659-4a89-9942-bd0f1963dfef tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:19.836584 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6229f0d6-9659-4a89-9942-bd0f1963dfef tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:19.837663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6229f0d6-9659-4a89-9942-bd0f1963dfef tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:19.838774 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6229f0d6-9659-4a89-9942-bd0f1963dfef tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:20.000936 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-6229f0d6-9659-4a89-9942-bd0f1963dfef tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:20.012023 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-6229f0d6-9659-4a89-9942-bd0f1963dfef tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25" status: 200 len: 1504 microversion: 2.1 time: 0.194999 Jul 07 10:28:20.012605 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 187/349] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:19 2022] GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 => generated 1504 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:20.112453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5708aaea-7b88-4016-9baa-f3a586206315 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:20.125933 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-82c17b00-f17a-4ca7-8eda-ce745259d3a2 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:20.126653 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-82c17b00-f17a-4ca7-8eda-ce745259d3a2 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:20.138113 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5708aaea-7b88-4016-9baa-f3a586206315 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1724 microversion: 2.1 time: 0.365709 Jul 07 10:28:20.139676 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-82c17b00-f17a-4ca7-8eda-ce745259d3a2 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:20.140617 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 163/350] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:19 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1724 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:20.140879 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-82c17b00-f17a-4ca7-8eda-ce745259d3a2 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:20.142184 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-82c17b00-f17a-4ca7-8eda-ce745259d3a2 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:20.142850 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-82c17b00-f17a-4ca7-8eda-ce745259d3a2 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:20.394060 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-82c17b00-f17a-4ca7-8eda-ce745259d3a2 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:20.418394 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-82c17b00-f17a-4ca7-8eda-ce745259d3a2 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1372 microversion: 2.1 time: 0.296359 Jul 07 10:28:20.433345 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 188/351] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:20 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1372 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:28:20.599570 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-36cdd364-e0dc-4654-9eab-36b7eda7f92d tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:20.600513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-36cdd364-e0dc-4654-9eab-36b7eda7f92d tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:20.610806 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-36cdd364-e0dc-4654-9eab-36b7eda7f92d tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:20.614761 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-36cdd364-e0dc-4654-9eab-36b7eda7f92d tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:20.615809 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-36cdd364-e0dc-4654-9eab-36b7eda7f92d tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:20.616961 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-36cdd364-e0dc-4654-9eab-36b7eda7f92d tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:20.803700 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-50b04e49-a174-4706-82f8-0d287815c3cb tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:20.806259 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-50b04e49-a174-4706-82f8-0d287815c3cb tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:20.836847 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-50b04e49-a174-4706-82f8-0d287815c3cb tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:20.837976 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-50b04e49-a174-4706-82f8-0d287815c3cb tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:20.841215 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-50b04e49-a174-4706-82f8-0d287815c3cb tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:20.841791 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-50b04e49-a174-4706-82f8-0d287815c3cb tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:20.889524 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-36cdd364-e0dc-4654-9eab-36b7eda7f92d tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:20.906062 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-36cdd364-e0dc-4654-9eab-36b7eda7f92d tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1594 microversion: 2.1 time: 0.310792 Jul 07 10:28:20.907466 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 164/352] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:20 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1594 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:21.029634 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-92307c96-7d3a-4af4-884f-7a095e824d19 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:21.030255 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-92307c96-7d3a-4af4-884f-7a095e824d19 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:21.046434 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-92307c96-7d3a-4af4-884f-7a095e824d19 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:21.049215 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-92307c96-7d3a-4af4-884f-7a095e824d19 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:21.052668 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-92307c96-7d3a-4af4-884f-7a095e824d19 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:21.053615 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-92307c96-7d3a-4af4-884f-7a095e824d19 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:21.372330 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-92307c96-7d3a-4af4-884f-7a095e824d19 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:21.382845 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-92307c96-7d3a-4af4-884f-7a095e824d19 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25" status: 200 len: 1504 microversion: 2.1 time: 0.357662 Jul 07 10:28:21.383683 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 165/353] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:21 2022] GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 => generated 1504 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:28:21.435613 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-50b04e49-a174-4706-82f8-0d287815c3cb tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:21.444701 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-50b04e49-a174-4706-82f8-0d287815c3cb tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6" status: 200 len: 1319 microversion: 2.1 time: 0.645307 Jul 07 10:28:21.456396 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 189/354] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:20 2022] GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 => generated 1319 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:21.472125 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-d4b94f64-0c29-423f-9ad7-77468b4189bd tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:21.473027 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-d4b94f64-0c29-423f-9ad7-77468b4189bd tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:21.485994 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d4b94f64-0c29-423f-9ad7-77468b4189bd tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:21.486708 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d4b94f64-0c29-423f-9ad7-77468b4189bd tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:21.487675 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d4b94f64-0c29-423f-9ad7-77468b4189bd tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:21.488454 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d4b94f64-0c29-423f-9ad7-77468b4189bd tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:21.738406 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-cfcc7584-a558-4c5e-9bb8-c02135d9b0c5 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Action: 'create', calling method: .version_select at 0x7f9e9e5605e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-619699422", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLreretiyx5MdExSL/hMVXi9GX1wlduhIN3BMCwBovm0N35DOSsNsf8WPUqIHE9eIfsVb7dBzyxsMK30nmKHHUH7kB9woIRbPpapFMjWtCLQgNv+y/fNCsjNkEHif9aBDg=="}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:28:21.758942 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-cfcc7584-a558-4c5e-9bb8-c02135d9b0c5 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Getting quotas for project 21dabce5b3274cfcba5840982b59434e. Resources: {'key_pairs'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:28:21.760506 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-d4b94f64-0c29-423f-9ad7-77468b4189bd tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:21.765650 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-cfcc7584-a558-4c5e-9bb8-c02135d9b0c5 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Getting quotas for user d8c69ecf2f23490c92ab315433273817 and project 21dabce5b3274cfcba5840982b59434e. Resources: {'key_pairs'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:28:21.786062 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-d4b94f64-0c29-423f-9ad7-77468b4189bd tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1724 microversion: 2.1 time: 0.311334 Jul 07 10:28:21.787329 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 190/355] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:21 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1724 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:21.792223 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-d85187c6-565b-4bce-acb7-69f9cf39fe03 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:21.793026 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-d85187c6-565b-4bce-acb7-69f9cf39fe03 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:21.795146 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-cfcc7584-a558-4c5e-9bb8-c02135d9b0c5 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.410188 Jul 07 10:28:21.796429 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 166/356] 10.222.0.16 () {60 vars in 1158 bytes} [Thu Jul 7 10:28:21 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:28:21.804833 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d85187c6-565b-4bce-acb7-69f9cf39fe03 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:21.805852 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d85187c6-565b-4bce-acb7-69f9cf39fe03 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:21.806814 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d85187c6-565b-4bce-acb7-69f9cf39fe03 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:21.807255 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d85187c6-565b-4bce-acb7-69f9cf39fe03 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:22.224321 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-648564cb-94d7-4fdb-ad1a-d5775d9ec419 req-8f21421f-4fbd-4361-b033-e5ca13c28f48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25", "name": "network-vif-deleted", "tag": "1c55b0d4-9584-4b2b-8435-9d7ca3e79dbe"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:28:22.249072 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-648564cb-94d7-4fdb-ad1a-d5775d9ec419 req-8f21421f-4fbd-4361-b033-e5ca13c28f48 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:22.252833 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-648564cb-94d7-4fdb-ad1a-d5775d9ec419 req-8f21421f-4fbd-4361-b033-e5ca13c28f48 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:22.291878 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-648564cb-94d7-4fdb-ad1a-d5775d9ec419 req-8f21421f-4fbd-4361-b033-e5ca13c28f48 service nova] Creating event network-vif-deleted:1c55b0d4-9584-4b2b-8435-9d7ca3e79dbe for instance f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 on hv-cinder-82282 Jul 07 10:28:22.308091 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-648564cb-94d7-4fdb-ad1a-d5775d9ec419 req-8f21421f-4fbd-4361-b033-e5ca13c28f48 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090292 Jul 07 10:28:22.312142 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 167/357] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 10:28:22.405642 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b249dd2b-77a0-4312-bf31-41d787ddcf73 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:22.406796 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b249dd2b-77a0-4312-bf31-41d787ddcf73 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:22.420433 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-d85187c6-565b-4bce-acb7-69f9cf39fe03 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:22.429950 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b249dd2b-77a0-4312-bf31-41d787ddcf73 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:22.430537 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b249dd2b-77a0-4312-bf31-41d787ddcf73 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:22.431484 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b249dd2b-77a0-4312-bf31-41d787ddcf73 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:22.432067 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b249dd2b-77a0-4312-bf31-41d787ddcf73 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:22.433901 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-d85187c6-565b-4bce-acb7-69f9cf39fe03 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1372 microversion: 2.1 time: 0.645281 Jul 07 10:28:22.434489 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 191/358] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:21 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1372 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:22.473564 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-f09339e9-056c-4dd4-9549-d740e04b175e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:22.474484 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-f09339e9-056c-4dd4-9549-d740e04b175e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:22.486472 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f09339e9-056c-4dd4-9549-d740e04b175e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:22.488460 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f09339e9-056c-4dd4-9549-d740e04b175e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:22.489671 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f09339e9-056c-4dd4-9549-d740e04b175e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:22.490475 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b249dd2b-77a0-4312-bf31-41d787ddcf73 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:22.491188 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b249dd2b-77a0-4312-bf31-41d787ddcf73 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:22.491941 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.objects.instance [None req-b249dd2b-77a0-4312-bf31-41d787ddcf73 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lazy-loading 'fault' on Instance uuid f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 {{(pid=117647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 10:28:22.493094 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f09339e9-056c-4dd4-9549-d740e04b175e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:22.574426 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b249dd2b-77a0-4312-bf31-41d787ddcf73 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28b6a7ebf8c4cbab9193b95b8de6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3b58b3beed423aba9a7c28d1e09c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:22.583601 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b249dd2b-77a0-4312-bf31-41d787ddcf73 tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25" status: 200 len: 1304 microversion: 2.1 time: 0.185803 Jul 07 10:28:22.595629 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 168/359] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:22 2022] GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 => generated 1304 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:22.764762 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-f09339e9-056c-4dd4-9549-d740e04b175e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:22.775132 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-f09339e9-056c-4dd4-9549-d740e04b175e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6" status: 200 len: 1507 microversion: 2.1 time: 0.306595 Jul 07 10:28:22.776612 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 192/360] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:22 2022] GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 => generated 1507 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:28:22.803858 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-54c88c7d-e07e-419c-9be3-ea1dac223c54 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:22.804764 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-54c88c7d-e07e-419c-9be3-ea1dac223c54 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:22.845658 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-54c88c7d-e07e-419c-9be3-ea1dac223c54 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:22.846180 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-54c88c7d-e07e-419c-9be3-ea1dac223c54 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:22.848151 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-54c88c7d-e07e-419c-9be3-ea1dac223c54 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:22.848608 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-54c88c7d-e07e-419c-9be3-ea1dac223c54 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:23.103952 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-b9e92f83-9090-4f92-9060-ebcc4c6bbcd7 req-8caf5b6c-ec89-4696-979f-45bbf1a27798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5080ca5c-bf77-4305-877b-c992e9248b40", "name": "network-vif-plugged", "status": "completed", "tag": "f2d0b2c3-ea20-4eea-87fe-434f9d0de45e"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:28:23.104993 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-54c88c7d-e07e-419c-9be3-ea1dac223c54 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:23.113377 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-54c88c7d-e07e-419c-9be3-ea1dac223c54 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1701 microversion: 2.1 time: 0.313543 Jul 07 10:28:23.127295 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-b9e92f83-9090-4f92-9060-ebcc4c6bbcd7 req-8caf5b6c-ec89-4696-979f-45bbf1a27798 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:23.127295 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-b9e92f83-9090-4f92-9060-ebcc4c6bbcd7 req-8caf5b6c-ec89-4696-979f-45bbf1a27798 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:23.129128 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 169/361] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:22 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1701 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:23.134983 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4580553e-a037-4aa8-8e93-ab44597cb7ec tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:28:23.143661 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4580553e-a037-4aa8-8e93-ab44597cb7ec tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:23.144430 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4580553e-a037-4aa8-8e93-ab44597cb7ec tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:23.144820 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:28:23.149860 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-b9e92f83-9090-4f92-9060-ebcc4c6bbcd7 req-8caf5b6c-ec89-4696-979f-45bbf1a27798 service nova] Creating event network-vif-plugged:f2d0b2c3-ea20-4eea-87fe-434f9d0de45e for instance 5080ca5c-bf77-4305-877b-c992e9248b40 on hv-cinder-82282 Jul 07 10:28:23.163990 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-b9e92f83-9090-4f92-9060-ebcc4c6bbcd7 req-8caf5b6c-ec89-4696-979f-45bbf1a27798 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063555 Jul 07 10:28:23.164595 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 193/362] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 10:28:23.213105 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-4580553e-a037-4aa8-8e93-ab44597cb7ec tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Going to try to start instance {{(pid=117647) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 07 10:28:23.289350 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-4580553e-a037-4aa8-8e93-ab44597cb7ec tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "POST /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0/action" status: 202 len: 0 microversion: 2.1 time: 0.157952 Jul 07 10:28:23.292059 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 170/363] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Jul 7 10:28:23 2022] POST /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 10:28:23.301254 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-16a3baf3-fb79-4af5-bcde-d5e7670d807f tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:23.302033 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-16a3baf3-fb79-4af5-bcde-d5e7670d807f tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:23.315194 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-16a3baf3-fb79-4af5-bcde-d5e7670d807f tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:23.319371 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-16a3baf3-fb79-4af5-bcde-d5e7670d807f tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:23.320433 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-16a3baf3-fb79-4af5-bcde-d5e7670d807f tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:23.320883 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-16a3baf3-fb79-4af5-bcde-d5e7670d807f tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:23.451344 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1073b59b-440b-4bed-87ab-1140ff8c991f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:23.452083 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1073b59b-440b-4bed-87ab-1140ff8c991f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:23.463447 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1073b59b-440b-4bed-87ab-1140ff8c991f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:23.463831 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1073b59b-440b-4bed-87ab-1140ff8c991f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:23.464628 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1073b59b-440b-4bed-87ab-1140ff8c991f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:23.465073 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1073b59b-440b-4bed-87ab-1140ff8c991f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:23.725593 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-1073b59b-440b-4bed-87ab-1140ff8c991f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:23.737588 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1073b59b-440b-4bed-87ab-1140ff8c991f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1372 microversion: 2.1 time: 0.289593 Jul 07 10:28:23.738171 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 171/364] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:23 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1372 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:23.757182 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-183e6470-e2de-4ee0-9e81-d35ac43d302f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:23.757790 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-183e6470-e2de-4ee0-9e81-d35ac43d302f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] [instance: f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:23.779696 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-183e6470-e2de-4ee0-9e81-d35ac43d302f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:23.780192 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-183e6470-e2de-4ee0-9e81-d35ac43d302f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:23.780981 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-183e6470-e2de-4ee0-9e81-d35ac43d302f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:23.781420 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-183e6470-e2de-4ee0-9e81-d35ac43d302f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:23.820702 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-183e6470-e2de-4ee0-9e81-d35ac43d302f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] HTTP exception thrown: Instance f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 could not be found. Jul 07 10:28:23.822525 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-183e6470-e2de-4ee0-9e81-d35ac43d302f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Request method failure captured: Jul 07 10:28:23.822525 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 HTTP/1.1 Jul 07 10:28:23.822525 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept: application/json Jul 07 10:28:23.822525 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jul 07 10:28:23.822525 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Connection: close Jul 07 10:28:23.822525 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jul 07 10:28:23.822525 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jul 07 10:28:23.822525 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Host: 10.222.0.16 Jul 07 10:28:23.822525 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jul 07 10:28:23.822525 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jul 07 10:28:23.822525 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABixrUCGzeTuIsKcaWSWKTZjgGLMFvMGp6vaqqg1QGrnKHODOs32hu3VIe75VDNIwMeYpkFNJ9menDFl82_gMsV0AWRnXfy9XuxF6TFUGeQKZlz9m405gQx_fSGZDAU5psKBlV9qCfibR_AXqZl_LvtxvtzeHHtGHoqoo1Ob_NUsJUCEOo Jul 07 10:28:23.822525 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jul 07 10:28:23.822525 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jul 07 10:28:23.822525 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jul 07 10:28:23.822525 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jul 07 10:28:23.822525 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jul 07 10:28:23.822525 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jul 07 10:28:23.822525 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Id: 3d3b58b3beed423aba9a7c28d1e09c88 Jul 07 10:28:23.822525 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-VolumesActionsTest-415571155 Jul 07 10:28:23.822525 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jul 07 10:28:23.822525 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jul 07 10:28:23.824192 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d3b58b3beed423aba9a7c28d1e09c88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3d3b58b3beed423aba9a7c28d1e09c88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d3b58b3beed423aba9a7c28d1e09c88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3d3b58b3beed423aba9a7c28d1e09c88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:28:23.824192 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-VolumesActionsTest-415571155 Jul 07 10:28:23.824192 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 3d3b58b3beed423aba9a7c28d1e09c88 Jul 07 10:28:23.824192 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-VolumesActionsTest-415571155 Jul 07 10:28:23.824192 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User: tempest-VolumesActionsTest-415571155-project Jul 07 10:28:23.824192 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jul 07 10:28:23.824192 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jul 07 10:28:23.824192 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Id: f28b6a7ebf8c4cbab9193b95b8de6818 Jul 07 10:28:23.824192 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-VolumesActionsTest-415571155-project Jul 07 10:28:23.824192 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: method: > Jul 07 10:28:23.824192 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: exception: Instance f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 could not be found. Jul 07 10:28:23.824192 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: action_args: {'id': 'f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25'} Jul 07 10:28:23.825059 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:28:23.825059 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:28:23.825059 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:28:23.825059 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:28:23.825059 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:28:23.825059 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:28:23.825059 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:28:23.825059 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:28:23.825059 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:28:23.825059 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:28:23.825059 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 could not be found. Jul 07 10:28:23.825059 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:28:23.825059 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:28:23.825059 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:28:23.825059 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:28:23.825059 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:28:23.825059 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:28:23.825059 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:28:23.825059 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:28:23.825059 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:28:23.826499 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:28:23.826499 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:28:23.826499 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:28:23.826499 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:28:23.826499 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:28:23.826499 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:28:23.826499 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:28:23.826499 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 could not be found. Jul 07 10:28:23.826499 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:28:23.826499 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:28:23.826499 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:28:23.826499 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:28:23.826499 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:28:23.826499 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:28:23.826499 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:28:23.826499 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:28:23.826499 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 could not be found. Jul 07 10:28:23.826499 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:28:23.827796 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-183e6470-e2de-4ee0-9e81-d35ac43d302f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] Returning 404 to user: Instance f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:28:23.828885 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-183e6470-e2de-4ee0-9e81-d35ac43d302f tempest-VolumesActionsTest-415571155 tempest-VolumesActionsTest-415571155-project] 10.222.0.16 "GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25" status: 404 len: 111 microversion: 2.1 time: 0.072538 Jul 07 10:28:23.829971 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 172/365] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:23 2022] GET /compute/v2.1/servers/f1cfff3b-6cbb-4e2a-8a45-ef060c4d3c25 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:28:23.852851 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-16a3baf3-fb79-4af5-bcde-d5e7670d807f tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:23.878885 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-16a3baf3-fb79-4af5-bcde-d5e7670d807f tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1710 microversion: 2.1 time: 0.572357 Jul 07 10:28:23.880702 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 194/366] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:23 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1710 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:24.755422 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a915abde-8a74-4103-93ad-024cbfc48948 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:24.756121 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a915abde-8a74-4103-93ad-024cbfc48948 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:24.764915 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a915abde-8a74-4103-93ad-024cbfc48948 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:24.767486 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a915abde-8a74-4103-93ad-024cbfc48948 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:24.768660 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a915abde-8a74-4103-93ad-024cbfc48948 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:24.771166 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a915abde-8a74-4103-93ad-024cbfc48948 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:24.904219 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-33a7cedf-dc83-43ec-aac9-3c3a365a5202 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:24.919695 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-33a7cedf-dc83-43ec-aac9-3c3a365a5202 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:24.941753 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-33a7cedf-dc83-43ec-aac9-3c3a365a5202 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:24.942546 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-33a7cedf-dc83-43ec-aac9-3c3a365a5202 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:24.943642 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-33a7cedf-dc83-43ec-aac9-3c3a365a5202 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:24.944326 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-33a7cedf-dc83-43ec-aac9-3c3a365a5202 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:25.278618 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-33a7cedf-dc83-43ec-aac9-3c3a365a5202 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:25.293082 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-33a7cedf-dc83-43ec-aac9-3c3a365a5202 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1710 microversion: 2.1 time: 0.398912 Jul 07 10:28:25.301152 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 195/367] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:24 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1710 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:25.337642 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a915abde-8a74-4103-93ad-024cbfc48948 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:25.345796 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a915abde-8a74-4103-93ad-024cbfc48948 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1372 microversion: 2.1 time: 0.595083 Jul 07 10:28:25.346754 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 173/368] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:24 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1372 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:25.594185 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-39231733-3eef-48b7-9ea6-246ea74c53ac req-4a0244ba-6235-4e5b-bcb0-a53ae175fa5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca65cd17-61ba-4122-ba4b-59953053de02", "tag": "9e1716e6-ca2c-42e2-be39-5e2596494efc"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:28:25.602827 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-39231733-3eef-48b7-9ea6-246ea74c53ac req-4a0244ba-6235-4e5b-bcb0-a53ae175fa5d service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:25.603560 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-39231733-3eef-48b7-9ea6-246ea74c53ac req-4a0244ba-6235-4e5b-bcb0-a53ae175fa5d service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:25.617493 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-39231733-3eef-48b7-9ea6-246ea74c53ac req-4a0244ba-6235-4e5b-bcb0-a53ae175fa5d service nova] Creating event network-changed:9e1716e6-ca2c-42e2-be39-5e2596494efc for instance ca65cd17-61ba-4122-ba4b-59953053de02 on hv-cinder-82282 Jul 07 10:28:25.623029 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-39231733-3eef-48b7-9ea6-246ea74c53ac req-4a0244ba-6235-4e5b-bcb0-a53ae175fa5d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033965 Jul 07 10:28:25.623626 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 196/369] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:28:26.310718 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-f094e794-c6b2-4be5-bb92-f18127aba912 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:26.311334 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-f094e794-c6b2-4be5-bb92-f18127aba912 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:26.321191 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f094e794-c6b2-4be5-bb92-f18127aba912 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:26.322033 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f094e794-c6b2-4be5-bb92-f18127aba912 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:26.322980 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f094e794-c6b2-4be5-bb92-f18127aba912 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:26.323431 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f094e794-c6b2-4be5-bb92-f18127aba912 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:26.368697 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-6f8a8f0c-a03f-47fe-b2c7-77367c01d4bc tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:26.370301 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-6f8a8f0c-a03f-47fe-b2c7-77367c01d4bc tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:26.380415 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6f8a8f0c-a03f-47fe-b2c7-77367c01d4bc tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:26.381387 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6f8a8f0c-a03f-47fe-b2c7-77367c01d4bc tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:26.384057 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6f8a8f0c-a03f-47fe-b2c7-77367c01d4bc tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:26.384917 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6f8a8f0c-a03f-47fe-b2c7-77367c01d4bc tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:26.479554 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f094e794-c6b2-4be5-bb92-f18127aba912 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:26.488527 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-f094e794-c6b2-4be5-bb92-f18127aba912 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1710 microversion: 2.1 time: 0.181914 Jul 07 10:28:26.499573 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 174/370] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:26 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1710 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:26.606812 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-6f8a8f0c-a03f-47fe-b2c7-77367c01d4bc tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:26.614584 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-6f8a8f0c-a03f-47fe-b2c7-77367c01d4bc tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1372 microversion: 2.1 time: 0.253272 Jul 07 10:28:26.624060 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 197/371] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:26 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1372 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:28:26.941743 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-72984cf5-0c43-43f0-8855-6924a5cb2337 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1712880761"}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:28:26.942275 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-72984cf5-0c43-43f0-8855-6924a5cb2337 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:26.949431 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-72984cf5-0c43-43f0-8855-6924a5cb2337 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:26.949874 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-72984cf5-0c43-43f0-8855-6924a5cb2337 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:26.950621 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-72984cf5-0c43-43f0-8855-6924a5cb2337 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:26.951210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-72984cf5-0c43-43f0-8855-6924a5cb2337 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:27.077219 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.network.security_group_api [None req-72984cf5-0c43-43f0-8855-6924a5cb2337 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Adding security group ab825954-2df2-4bb0-978d-9769ce31159f to port 9e1716e6-ca2c-42e2-be39-5e2596494efc Jul 07 10:28:27.430105 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-72984cf5-0c43-43f0-8855-6924a5cb2337 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "POST /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02/action" status: 202 len: 0 microversion: 2.1 time: 0.492160 Jul 07 10:28:27.430714 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 175/372] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Jul 7 10:28:26 2022] POST /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 10:28:27.438995 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-abfe1815-b4c0-42ae-af69-fb3f71be12ae tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:27.445829 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-abfe1815-b4c0-42ae-af69-fb3f71be12ae tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:27.447624 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-c36c0fcf-260b-4b38-89d5-4ab197c62076 req-d99aab3f-3b88-4ef4-9ed3-8828dbfd608a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca65cd17-61ba-4122-ba4b-59953053de02", "tag": "9e1716e6-ca2c-42e2-be39-5e2596494efc"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:28:27.458341 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-abfe1815-b4c0-42ae-af69-fb3f71be12ae tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:27.458840 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-abfe1815-b4c0-42ae-af69-fb3f71be12ae tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:27.459591 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-abfe1815-b4c0-42ae-af69-fb3f71be12ae tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:27.462249 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-abfe1815-b4c0-42ae-af69-fb3f71be12ae tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:27.470606 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-c36c0fcf-260b-4b38-89d5-4ab197c62076 req-d99aab3f-3b88-4ef4-9ed3-8828dbfd608a service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:27.471014 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-c36c0fcf-260b-4b38-89d5-4ab197c62076 req-d99aab3f-3b88-4ef4-9ed3-8828dbfd608a service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:27.487396 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-c36c0fcf-260b-4b38-89d5-4ab197c62076 req-d99aab3f-3b88-4ef4-9ed3-8828dbfd608a service nova] Creating event network-changed:9e1716e6-ca2c-42e2-be39-5e2596494efc for instance ca65cd17-61ba-4122-ba4b-59953053de02 on hv-cinder-82282 Jul 07 10:28:27.492712 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-c36c0fcf-260b-4b38-89d5-4ab197c62076 req-d99aab3f-3b88-4ef4-9ed3-8828dbfd608a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050994 Jul 07 10:28:27.493396 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 176/373] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:28:27.506611 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2c38e826-5129-4085-a8b9-a08986cc9c40 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:27.507417 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-2c38e826-5129-4085-a8b9-a08986cc9c40 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:27.517192 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2c38e826-5129-4085-a8b9-a08986cc9c40 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:27.518026 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2c38e826-5129-4085-a8b9-a08986cc9c40 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:27.519038 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2c38e826-5129-4085-a8b9-a08986cc9c40 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:27.519967 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2c38e826-5129-4085-a8b9-a08986cc9c40 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:27.673869 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-abfe1815-b4c0-42ae-af69-fb3f71be12ae tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:27.682666 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-abfe1815-b4c0-42ae-af69-fb3f71be12ae tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1641 microversion: 2.1 time: 0.247448 Jul 07 10:28:27.683789 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 198/374] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:27 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1641 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:27.688865 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-3d2d4c10-104a-468e-80c0-a72af39b1b96 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:27.689465 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-3d2d4c10-104a-468e-80c0-a72af39b1b96 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:27.696775 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3d2d4c10-104a-468e-80c0-a72af39b1b96 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:27.697566 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3d2d4c10-104a-468e-80c0-a72af39b1b96 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:27.702263 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-2c38e826-5129-4085-a8b9-a08986cc9c40 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:27.706473 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3d2d4c10-104a-468e-80c0-a72af39b1b96 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:27.707217 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3d2d4c10-104a-468e-80c0-a72af39b1b96 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:27.714884 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-2c38e826-5129-4085-a8b9-a08986cc9c40 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1710 microversion: 2.1 time: 0.212215 Jul 07 10:28:27.718572 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 177/375] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:27 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1710 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:28:27.858721 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-3d2d4c10-104a-468e-80c0-a72af39b1b96 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:27.866290 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-3d2d4c10-104a-468e-80c0-a72af39b1b96 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1372 microversion: 2.1 time: 0.181113 Jul 07 10:28:27.866855 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 199/376] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:27 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1372 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:28.736451 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-96c72542-a5ac-431a-8078-e06a05292bcc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:28.737598 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-96c72542-a5ac-431a-8078-e06a05292bcc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:28.752677 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-96c72542-a5ac-431a-8078-e06a05292bcc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:28.753141 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-96c72542-a5ac-431a-8078-e06a05292bcc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:28.753935 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-96c72542-a5ac-431a-8078-e06a05292bcc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:28.754380 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-96c72542-a5ac-431a-8078-e06a05292bcc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:28.888506 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-c1b31bf5-9085-4a57-aef0-ffa1d60a7133 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:28.890369 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-c1b31bf5-9085-4a57-aef0-ffa1d60a7133 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:28.900132 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c1b31bf5-9085-4a57-aef0-ffa1d60a7133 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:28.900846 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c1b31bf5-9085-4a57-aef0-ffa1d60a7133 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:28.901060 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-96c72542-a5ac-431a-8078-e06a05292bcc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:28.902037 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c1b31bf5-9085-4a57-aef0-ffa1d60a7133 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:28.902586 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c1b31bf5-9085-4a57-aef0-ffa1d60a7133 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:28.910774 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-96c72542-a5ac-431a-8078-e06a05292bcc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1710 microversion: 2.1 time: 0.180247 Jul 07 10:28:28.922564 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 178/377] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:28 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1710 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:29.116879 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-c1b31bf5-9085-4a57-aef0-ffa1d60a7133 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:29.124408 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-c1b31bf5-9085-4a57-aef0-ffa1d60a7133 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1566 microversion: 2.1 time: 0.243217 Jul 07 10:28:29.124973 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 200/378] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:28 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1566 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:29.140405 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a51699db-2380-46cb-9948-b7c49741c21d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:29.140915 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a51699db-2380-46cb-9948-b7c49741c21d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:29.146959 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a51699db-2380-46cb-9948-b7c49741c21d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:29.147953 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a51699db-2380-46cb-9948-b7c49741c21d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:29.148720 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a51699db-2380-46cb-9948-b7c49741c21d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:29.149161 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a51699db-2380-46cb-9948-b7c49741c21d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:29.230523 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a51699db-2380-46cb-9948-b7c49741c21d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093930 Jul 07 10:28:29.231121 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 179/379] 10.222.0.16 () {58 vars in 1274 bytes} [Thu Jul 7 10:28:29 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:28:29.929624 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-190c5e8d-b59a-4f0d-b227-70fe30d3ebc7 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:29.930778 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-190c5e8d-b59a-4f0d-b227-70fe30d3ebc7 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:29.939378 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-190c5e8d-b59a-4f0d-b227-70fe30d3ebc7 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:29.939862 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-190c5e8d-b59a-4f0d-b227-70fe30d3ebc7 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:29.940890 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-190c5e8d-b59a-4f0d-b227-70fe30d3ebc7 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:29.941312 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-190c5e8d-b59a-4f0d-b227-70fe30d3ebc7 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:30.172960 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-190c5e8d-b59a-4f0d-b227-70fe30d3ebc7 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:30.181414 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-190c5e8d-b59a-4f0d-b227-70fe30d3ebc7 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1714 microversion: 2.1 time: 0.255681 Jul 07 10:28:30.188669 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 201/380] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:29 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1714 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:30.693378 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-970211be-d405-4390-b385-dd6fcb3dfede req-968b8581-89f0-409d-8099-99b837ed1fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5080ca5c-bf77-4305-877b-c992e9248b40", "tag": "f2d0b2c3-ea20-4eea-87fe-434f9d0de45e"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:28:30.702423 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-970211be-d405-4390-b385-dd6fcb3dfede req-968b8581-89f0-409d-8099-99b837ed1fd3 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:30.702717 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-970211be-d405-4390-b385-dd6fcb3dfede req-968b8581-89f0-409d-8099-99b837ed1fd3 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:30.713903 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-970211be-d405-4390-b385-dd6fcb3dfede req-968b8581-89f0-409d-8099-99b837ed1fd3 service nova] Creating event network-changed:f2d0b2c3-ea20-4eea-87fe-434f9d0de45e for instance 5080ca5c-bf77-4305-877b-c992e9248b40 on hv-cinder-82282 Jul 07 10:28:30.720147 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-970211be-d405-4390-b385-dd6fcb3dfede req-968b8581-89f0-409d-8099-99b837ed1fd3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030570 Jul 07 10:28:30.724314 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 180/381] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:28:52.987687 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-f7423b12-9eff-44e0-b6fd-42af6312ba55 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c2f8237-fc28-4594-8737-7fd0729acb96", "device": "/dev/sdb"}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:28:52.990039 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-f7423b12-9eff-44e0-b6fd-42af6312ba55 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:52.996302 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:28:52.997309 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=44 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:28:52.999090 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f7423b12-9eff-44e0-b6fd-42af6312ba55 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:52.999823 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f7423b12-9eff-44e0-b6fd-42af6312ba55 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:53.000939 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f7423b12-9eff-44e0-b6fd-42af6312ba55 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:53.001595 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f7423b12-9eff-44e0-b6fd-42af6312ba55 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:53.303090 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-f7423b12-9eff-44e0-b6fd-42af6312ba55 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "POST /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319259 Jul 07 10:28:53.303977 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 202/382] 10.222.0.16 () {60 vars in 1322 bytes} [Thu Jul 7 10:28:52 2022] POST /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:28:54.973729 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=4 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:28:54.974729 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:28:54.975718 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:28:54.980759 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-06a938c2-a391-4950-b639-6e96e9fdd7de tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-503401800", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-619699422", "security_groups": [{"name": "tempest-secgroup-smoke-583081799"}], "networks": [{"uuid": "cbfa4801-202b-454f-bc73-ce3fcb0dea90"}], "block_device_mapping_v2": [{"uuid": "ad5dfd75-2a76-410f-8375-f1f3c5cd48a4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:28:55.112333 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.network.neutron [None req-06a938c2-a391-4950-b639-6e96e9fdd7de tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] validate_networks() for [('cbfa4801-202b-454f-bc73-ce3fcb0dea90', None, None, None, None, None)] {{(pid=117647) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 10:28:55.532205 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-06a938c2-a391-4950-b639-6e96e9fdd7de tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Flavor limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 10:28:55.532634 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-06a938c2-a391-4950-b639-6e96e9fdd7de tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Image limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 10:28:55.533121 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-06a938c2-a391-4950-b639-6e96e9fdd7de tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Flavor pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 10:28:55.533531 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-06a938c2-a391-4950-b639-6e96e9fdd7de tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Image pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 10:28:55.533943 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-06a938c2-a391-4950-b639-6e96e9fdd7de tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 10:28:55.545077 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-06a938c2-a391-4950-b639-6e96e9fdd7de tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:55.545536 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-06a938c2-a391-4950-b639-6e96e9fdd7de tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:55.546515 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-06a938c2-a391-4950-b639-6e96e9fdd7de tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:55.546960 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-06a938c2-a391-4950-b639-6e96e9fdd7de tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:55.565724 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-06a938c2-a391-4950-b639-6e96e9fdd7de tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Getting quotas for project 21dabce5b3274cfcba5840982b59434e. Resources: {'cores', 'ram', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:28:55.570925 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-06a938c2-a391-4950-b639-6e96e9fdd7de tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Getting quotas for user d8c69ecf2f23490c92ab315433273817 and project 21dabce5b3274cfcba5840982b59434e. Resources: {'cores', 'ram', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:28:55.646234 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-06a938c2-a391-4950-b639-6e96e9fdd7de tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Going to run 1 instances... {{(pid=117647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 10:28:55.649314 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-06a938c2-a391-4950-b639-6e96e9fdd7de tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ad5dfd75-2a76-410f-8375-f1f3c5cd48a4',volume_size=None,volume_type=None)] {{(pid=117647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 10:28:55.798446 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-06a938c2-a391-4950-b639-6e96e9fdd7de tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.825971 Jul 07 10:28:55.799198 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 181/383] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jul 7 10:28:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 10:28:55.810760 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-2a9b0c40-2c5f-40e8-9210-e5783fb185b7 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:55.812214 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-2a9b0c40-2c5f-40e8-9210-e5783fb185b7 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:55.884977 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-2a9b0c40-2c5f-40e8-9210-e5783fb185b7 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:55.897260 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-2a9b0c40-2c5f-40e8-9210-e5783fb185b7 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1087 microversion: 2.1 time: 0.090884 Jul 07 10:28:55.908967 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 203/384] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:55 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1087 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:28:56.916489 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2f3a9b11-1081-407e-ba13-ce79fb5cab45 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:56.917263 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-2f3a9b11-1081-407e-ba13-ce79fb5cab45 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:56.930080 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2f3a9b11-1081-407e-ba13-ce79fb5cab45 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:56.930635 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2f3a9b11-1081-407e-ba13-ce79fb5cab45 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:56.931327 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2f3a9b11-1081-407e-ba13-ce79fb5cab45 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:56.933933 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2f3a9b11-1081-407e-ba13-ce79fb5cab45 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:57.029304 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-2f3a9b11-1081-407e-ba13-ce79fb5cab45 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:57.037938 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-2f3a9b11-1081-407e-ba13-ce79fb5cab45 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1185 microversion: 2.1 time: 0.125968 Jul 07 10:28:57.043852 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 182/385] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:56 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:58.067790 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-71a94497-da85-4b4a-b3bb-34e7f26178af tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:58.069035 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-71a94497-da85-4b4a-b3bb-34e7f26178af tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:58.087441 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-71a94497-da85-4b4a-b3bb-34e7f26178af tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:58.088139 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-71a94497-da85-4b4a-b3bb-34e7f26178af tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:58.089801 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-71a94497-da85-4b4a-b3bb-34e7f26178af tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:58.094131 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-71a94497-da85-4b4a-b3bb-34e7f26178af tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:58.311716 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-71a94497-da85-4b4a-b3bb-34e7f26178af tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:58.328168 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-71a94497-da85-4b4a-b3bb-34e7f26178af tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1270 microversion: 2.1 time: 0.263843 Jul 07 10:28:58.342611 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 204/386] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:58 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1270 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:28:58.953206 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-b0410cd7-f370-4c0d-911c-135fed99c4dc req-994f53c8-357f-429c-9418-e84e3974fade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f3963fd-1a48-4f86-a15e-c4fbcadc5911", "tag": "52658524-0e22-481a-99ab-eb339029366f"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:28:58.980554 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-b0410cd7-f370-4c0d-911c-135fed99c4dc req-994f53c8-357f-429c-9418-e84e3974fade service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:58.982022 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-b0410cd7-f370-4c0d-911c-135fed99c4dc req-994f53c8-357f-429c-9418-e84e3974fade service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:59.018455 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-b0410cd7-f370-4c0d-911c-135fed99c4dc req-994f53c8-357f-429c-9418-e84e3974fade service nova] Creating event network-changed:52658524-0e22-481a-99ab-eb339029366f for instance 5f3963fd-1a48-4f86-a15e-c4fbcadc5911 on hv-cinder-82282 Jul 07 10:28:59.028084 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-b0410cd7-f370-4c0d-911c-135fed99c4dc req-994f53c8-357f-429c-9418-e84e3974fade service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078469 Jul 07 10:28:59.029061 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 183/387] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:28:59.349883 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-d8170811-aa73-40f3-aac3-89a169d5f443 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:28:59.350530 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-d8170811-aa73-40f3-aac3-89a169d5f443 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:28:59.357195 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d8170811-aa73-40f3-aac3-89a169d5f443 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:59.357896 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d8170811-aa73-40f3-aac3-89a169d5f443 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:59.358895 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d8170811-aa73-40f3-aac3-89a169d5f443 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:28:59.359315 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d8170811-aa73-40f3-aac3-89a169d5f443 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:28:59.790598 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-d8170811-aa73-40f3-aac3-89a169d5f443 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:28:59.810977 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-d8170811-aa73-40f3-aac3-89a169d5f443 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1270 microversion: 2.1 time: 0.464872 Jul 07 10:28:59.821725 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 205/388] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:28:59 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1270 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:00.447398 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a0d36980-4016-460d-9769-7974dcdd5c68 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:29:00.449084 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a0d36980-4016-460d-9769-7974dcdd5c68 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:00.463127 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a0d36980-4016-460d-9769-7974dcdd5c68 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:00.466337 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a0d36980-4016-460d-9769-7974dcdd5c68 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:00.467320 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a0d36980-4016-460d-9769-7974dcdd5c68 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:00.467976 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a0d36980-4016-460d-9769-7974dcdd5c68 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:00.624720 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a0d36980-4016-460d-9769-7974dcdd5c68 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "POST /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02/action" status: 202 len: 0 microversion: 2.1 time: 0.181989 Jul 07 10:29:00.626158 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 184/389] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Jul 7 10:29:00 2022] POST /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 10:29:00.636289 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-8aba8dd9-08c6-494e-a609-f2d0681209b2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:00.638431 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-8aba8dd9-08c6-494e-a609-f2d0681209b2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:00.658918 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8aba8dd9-08c6-494e-a609-f2d0681209b2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:00.658918 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8aba8dd9-08c6-494e-a609-f2d0681209b2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:00.659503 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8aba8dd9-08c6-494e-a609-f2d0681209b2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:00.660096 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8aba8dd9-08c6-494e-a609-f2d0681209b2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:00.835795 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-999a7971-f8f1-4ade-9c05-410d5a46bae9 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:00.836797 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-999a7971-f8f1-4ade-9c05-410d5a46bae9 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:00.843721 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-999a7971-f8f1-4ade-9c05-410d5a46bae9 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:00.844452 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-999a7971-f8f1-4ade-9c05-410d5a46bae9 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:00.845410 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-999a7971-f8f1-4ade-9c05-410d5a46bae9 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:00.845992 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-999a7971-f8f1-4ade-9c05-410d5a46bae9 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:01.045223 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-8aba8dd9-08c6-494e-a609-f2d0681209b2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:01.060413 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-999a7971-f8f1-4ade-9c05-410d5a46bae9 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:01.075215 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-999a7971-f8f1-4ade-9c05-410d5a46bae9 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1270 microversion: 2.1 time: 0.249838 Jul 07 10:29:01.076557 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-8aba8dd9-08c6-494e-a609-f2d0681209b2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1751 microversion: 2.1 time: 0.442278 Jul 07 10:29:01.078699 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 185/390] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:00 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1270 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:01.091018 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 206/391] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:00 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1751 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:02.092712 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-774502a7-3901-4d5e-8858-0225f4c7e06b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:02.093327 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-774502a7-3901-4d5e-8858-0225f4c7e06b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:02.097260 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-d1238a6f-919e-41f8-b6c9-cc969448eada tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:02.098002 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-d1238a6f-919e-41f8-b6c9-cc969448eada tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:02.100612 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-774502a7-3901-4d5e-8858-0225f4c7e06b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:02.101073 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-774502a7-3901-4d5e-8858-0225f4c7e06b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:02.102176 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-774502a7-3901-4d5e-8858-0225f4c7e06b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:02.102270 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-774502a7-3901-4d5e-8858-0225f4c7e06b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:02.107710 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d1238a6f-919e-41f8-b6c9-cc969448eada tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:02.108324 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d1238a6f-919e-41f8-b6c9-cc969448eada tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:02.109094 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d1238a6f-919e-41f8-b6c9-cc969448eada tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:02.109531 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d1238a6f-919e-41f8-b6c9-cc969448eada tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:02.245327 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-774502a7-3901-4d5e-8858-0225f4c7e06b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:02.252949 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-774502a7-3901-4d5e-8858-0225f4c7e06b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1258 microversion: 2.1 time: 0.164095 Jul 07 10:29:02.253509 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 186/392] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:02 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:02.258164 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-d1238a6f-919e-41f8-b6c9-cc969448eada tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:02.266020 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-d1238a6f-919e-41f8-b6c9-cc969448eada tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1751 microversion: 2.1 time: 0.172709 Jul 07 10:29:02.266564 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 207/393] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:02 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:29:03.270463 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-f2c633ec-6251-4a86-8298-a17fdd642475 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:03.271064 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-f2c633ec-6251-4a86-8298-a17fdd642475 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:03.278168 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f2c633ec-6251-4a86-8298-a17fdd642475 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:03.278615 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f2c633ec-6251-4a86-8298-a17fdd642475 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:03.279363 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f2c633ec-6251-4a86-8298-a17fdd642475 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:03.279812 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f2c633ec-6251-4a86-8298-a17fdd642475 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:03.282790 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a8dc8c2e-137e-4224-a01b-ac2cb9aa7030 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:03.283414 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-a8dc8c2e-137e-4224-a01b-ac2cb9aa7030 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:03.289947 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a8dc8c2e-137e-4224-a01b-ac2cb9aa7030 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:03.290427 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a8dc8c2e-137e-4224-a01b-ac2cb9aa7030 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:03.291189 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a8dc8c2e-137e-4224-a01b-ac2cb9aa7030 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:03.291627 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a8dc8c2e-137e-4224-a01b-ac2cb9aa7030 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:03.417465 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f2c633ec-6251-4a86-8298-a17fdd642475 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:03.425329 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-f2c633ec-6251-4a86-8298-a17fdd642475 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1258 microversion: 2.1 time: 0.158628 Jul 07 10:29:03.426076 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 187/394] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:03 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:03.437664 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-a8dc8c2e-137e-4224-a01b-ac2cb9aa7030 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:03.446463 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-a8dc8c2e-137e-4224-a01b-ac2cb9aa7030 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1751 microversion: 2.1 time: 0.167506 Jul 07 10:29:03.447015 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 208/395] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:03 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:29:04.442108 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-bae131fc-2258-4357-9621-e164c9c2e8ca tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:04.442727 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-bae131fc-2258-4357-9621-e164c9c2e8ca tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:04.449808 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bae131fc-2258-4357-9621-e164c9c2e8ca tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:04.450272 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bae131fc-2258-4357-9621-e164c9c2e8ca tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:04.451046 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bae131fc-2258-4357-9621-e164c9c2e8ca tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:04.451491 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bae131fc-2258-4357-9621-e164c9c2e8ca tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:04.463701 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-d2e51dc6-870b-4f8b-b80d-6995c2560fff tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:04.464327 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-d2e51dc6-870b-4f8b-b80d-6995c2560fff tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:04.470948 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d2e51dc6-870b-4f8b-b80d-6995c2560fff tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:04.471391 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d2e51dc6-870b-4f8b-b80d-6995c2560fff tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:04.472187 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d2e51dc6-870b-4f8b-b80d-6995c2560fff tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:04.472625 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d2e51dc6-870b-4f8b-b80d-6995c2560fff tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:04.585788 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-bae131fc-2258-4357-9621-e164c9c2e8ca tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:04.593076 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-bae131fc-2258-4357-9621-e164c9c2e8ca tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1258 microversion: 2.1 time: 0.154785 Jul 07 10:29:04.593636 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 188/396] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:04 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:04.615585 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-d2e51dc6-870b-4f8b-b80d-6995c2560fff tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:04.623713 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-d2e51dc6-870b-4f8b-b80d-6995c2560fff tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1751 microversion: 2.1 time: 0.163740 Jul 07 10:29:04.624290 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 209/397] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:04 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:29:05.611176 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1aecad07-c159-4580-a4ff-31ec705d72ef tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:05.611817 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1aecad07-c159-4580-a4ff-31ec705d72ef tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:05.616115 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:29:05.616933 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=6 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:29:05.621773 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1aecad07-c159-4580-a4ff-31ec705d72ef tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:05.622431 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1aecad07-c159-4580-a4ff-31ec705d72ef tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:05.623352 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1aecad07-c159-4580-a4ff-31ec705d72ef tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:05.623968 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1aecad07-c159-4580-a4ff-31ec705d72ef tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:05.641501 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-0a2b930a-e098-4241-a4c3-935c3516b555 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:05.642196 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-0a2b930a-e098-4241-a4c3-935c3516b555 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:05.671020 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0a2b930a-e098-4241-a4c3-935c3516b555 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:05.671477 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0a2b930a-e098-4241-a4c3-935c3516b555 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:05.674580 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0a2b930a-e098-4241-a4c3-935c3516b555 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:05.676729 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0a2b930a-e098-4241-a4c3-935c3516b555 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:05.791984 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-1aecad07-c159-4580-a4ff-31ec705d72ef tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:05.799584 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1aecad07-c159-4580-a4ff-31ec705d72ef tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1258 microversion: 2.1 time: 0.193709 Jul 07 10:29:05.800181 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 189/398] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:05 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1258 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:05.852483 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-0a2b930a-e098-4241-a4c3-935c3516b555 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:05.861299 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-0a2b930a-e098-4241-a4c3-935c3516b555 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1756 microversion: 2.1 time: 0.223881 Jul 07 10:29:05.861879 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 210/399] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:05 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1756 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:06.816618 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c9639bc2-bb42-41f2-914e-74e5f6ab2eb1 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:06.817236 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c9639bc2-bb42-41f2-914e-74e5f6ab2eb1 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:06.824492 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c9639bc2-bb42-41f2-914e-74e5f6ab2eb1 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:06.824945 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c9639bc2-bb42-41f2-914e-74e5f6ab2eb1 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:06.825815 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c9639bc2-bb42-41f2-914e-74e5f6ab2eb1 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:06.827266 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c9639bc2-bb42-41f2-914e-74e5f6ab2eb1 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:06.879978 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-19e067d4-5fe5-4b81-ab33-a55d2c4ac5bf tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:06.880594 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-19e067d4-5fe5-4b81-ab33-a55d2c4ac5bf tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:06.886900 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell0:SELECT=2 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:29:06.889480 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-19e067d4-5fe5-4b81-ab33-a55d2c4ac5bf tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:06.889928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-19e067d4-5fe5-4b81-ab33-a55d2c4ac5bf tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:06.891249 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-19e067d4-5fe5-4b81-ab33-a55d2c4ac5bf tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:06.891249 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-19e067d4-5fe5-4b81-ab33-a55d2c4ac5bf tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:06.960811 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c9639bc2-bb42-41f2-914e-74e5f6ab2eb1 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:06.968191 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c9639bc2-bb42-41f2-914e-74e5f6ab2eb1 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1258 microversion: 2.1 time: 0.155712 Jul 07 10:29:06.968754 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 190/400] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:06 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:07.037519 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-19e067d4-5fe5-4b81-ab33-a55d2c4ac5bf tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:07.045648 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-19e067d4-5fe5-4b81-ab33-a55d2c4ac5bf tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1756 microversion: 2.1 time: 0.169666 Jul 07 10:29:07.046202 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 211/401] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:06 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:29:07.984602 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-3e3f2771-4816-46ad-b413-619abcdedd03 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:07.985358 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-3e3f2771-4816-46ad-b413-619abcdedd03 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:07.991911 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3e3f2771-4816-46ad-b413-619abcdedd03 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:07.992365 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3e3f2771-4816-46ad-b413-619abcdedd03 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:07.993125 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3e3f2771-4816-46ad-b413-619abcdedd03 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:07.993565 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3e3f2771-4816-46ad-b413-619abcdedd03 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:08.062435 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-1509d3d4-d94c-4d09-9063-cc29a3aa3bf8 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:08.063084 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-1509d3d4-d94c-4d09-9063-cc29a3aa3bf8 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:08.069419 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1509d3d4-d94c-4d09-9063-cc29a3aa3bf8 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:08.070180 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1509d3d4-d94c-4d09-9063-cc29a3aa3bf8 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:08.070942 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1509d3d4-d94c-4d09-9063-cc29a3aa3bf8 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:08.071533 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1509d3d4-d94c-4d09-9063-cc29a3aa3bf8 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:08.124713 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-3e3f2771-4816-46ad-b413-619abcdedd03 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:08.132308 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-3e3f2771-4816-46ad-b413-619abcdedd03 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1258 microversion: 2.1 time: 0.151476 Jul 07 10:29:08.133038 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 191/402] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:07 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:08.210437 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-1509d3d4-d94c-4d09-9063-cc29a3aa3bf8 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:08.218372 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-1509d3d4-d94c-4d09-9063-cc29a3aa3bf8 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1756 microversion: 2.1 time: 0.159812 Jul 07 10:29:08.218937 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 212/403] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:08 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:29:09.149922 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-41487ce3-2801-4184-972a-7d73347be415 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:09.150646 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-41487ce3-2801-4184-972a-7d73347be415 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:09.157791 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-41487ce3-2801-4184-972a-7d73347be415 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:09.158233 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-41487ce3-2801-4184-972a-7d73347be415 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:09.158987 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-41487ce3-2801-4184-972a-7d73347be415 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:09.159468 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-41487ce3-2801-4184-972a-7d73347be415 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:09.234587 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-da728049-4223-41cc-90c1-af96942a4119 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:09.235285 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-da728049-4223-41cc-90c1-af96942a4119 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:09.243229 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-da728049-4223-41cc-90c1-af96942a4119 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:09.243229 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-da728049-4223-41cc-90c1-af96942a4119 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:09.244005 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-da728049-4223-41cc-90c1-af96942a4119 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:09.244555 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-da728049-4223-41cc-90c1-af96942a4119 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:09.307515 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-41487ce3-2801-4184-972a-7d73347be415 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:09.315714 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-41487ce3-2801-4184-972a-7d73347be415 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1258 microversion: 2.1 time: 0.171014 Jul 07 10:29:09.316471 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 192/404] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:09 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:09.393096 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-da728049-4223-41cc-90c1-af96942a4119 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:09.401009 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-da728049-4223-41cc-90c1-af96942a4119 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1756 microversion: 2.1 time: 0.170374 Jul 07 10:29:09.401572 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 213/405] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:09 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:29:10.333612 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c4727409-2a7d-4163-b29c-23651297aa08 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:10.334223 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c4727409-2a7d-4163-b29c-23651297aa08 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:10.340746 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c4727409-2a7d-4163-b29c-23651297aa08 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:10.341197 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c4727409-2a7d-4163-b29c-23651297aa08 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:10.341963 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c4727409-2a7d-4163-b29c-23651297aa08 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:10.342406 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c4727409-2a7d-4163-b29c-23651297aa08 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:10.418411 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-4cdea35b-f190-4a3a-86aa-8fe2af40c893 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:10.419029 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-4cdea35b-f190-4a3a-86aa-8fe2af40c893 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:10.425774 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4cdea35b-f190-4a3a-86aa-8fe2af40c893 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:10.426232 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4cdea35b-f190-4a3a-86aa-8fe2af40c893 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:10.427006 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4cdea35b-f190-4a3a-86aa-8fe2af40c893 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:10.427443 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4cdea35b-f190-4a3a-86aa-8fe2af40c893 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:10.482488 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c4727409-2a7d-4163-b29c-23651297aa08 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:10.490002 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c4727409-2a7d-4163-b29c-23651297aa08 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1258 microversion: 2.1 time: 0.160255 Jul 07 10:29:10.491430 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 193/406] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:10 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:10.659940 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-4cdea35b-f190-4a3a-86aa-8fe2af40c893 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:10.668485 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-4cdea35b-f190-4a3a-86aa-8fe2af40c893 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1756 microversion: 2.1 time: 0.254309 Jul 07 10:29:10.669058 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 214/407] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:10 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1756 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:29:11.506586 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-713abade-fc7c-4ce3-8bea-591101841b48 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:11.507760 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-713abade-fc7c-4ce3-8bea-591101841b48 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:11.514356 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-713abade-fc7c-4ce3-8bea-591101841b48 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:11.515072 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-713abade-fc7c-4ce3-8bea-591101841b48 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:11.516106 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-713abade-fc7c-4ce3-8bea-591101841b48 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:11.516773 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-713abade-fc7c-4ce3-8bea-591101841b48 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:11.650315 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-713abade-fc7c-4ce3-8bea-591101841b48 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:11.657765 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-713abade-fc7c-4ce3-8bea-591101841b48 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1258 microversion: 2.1 time: 0.155444 Jul 07 10:29:11.658328 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 194/408] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:11 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:11.685643 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-ade7501d-9126-4a9d-8a28-7e9eb4a631cd tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:11.686256 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-ade7501d-9126-4a9d-8a28-7e9eb4a631cd tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:11.692630 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ade7501d-9126-4a9d-8a28-7e9eb4a631cd tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:11.693265 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ade7501d-9126-4a9d-8a28-7e9eb4a631cd tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:11.694605 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ade7501d-9126-4a9d-8a28-7e9eb4a631cd tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:11.695303 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ade7501d-9126-4a9d-8a28-7e9eb4a631cd tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:11.835733 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-ade7501d-9126-4a9d-8a28-7e9eb4a631cd tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:11.843942 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-ade7501d-9126-4a9d-8a28-7e9eb4a631cd tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1756 microversion: 2.1 time: 0.162097 Jul 07 10:29:11.844646 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 215/409] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:11 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:12.674275 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a1f2806d-9524-47aa-a1b5-e829f1c273a2 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:12.674921 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a1f2806d-9524-47aa-a1b5-e829f1c273a2 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:12.681427 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a1f2806d-9524-47aa-a1b5-e829f1c273a2 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:12.681885 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a1f2806d-9524-47aa-a1b5-e829f1c273a2 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:12.682651 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a1f2806d-9524-47aa-a1b5-e829f1c273a2 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:12.683092 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a1f2806d-9524-47aa-a1b5-e829f1c273a2 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:12.814898 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a1f2806d-9524-47aa-a1b5-e829f1c273a2 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:12.823076 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a1f2806d-9524-47aa-a1b5-e829f1c273a2 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1258 microversion: 2.1 time: 0.152692 Jul 07 10:29:12.823647 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 195/410] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:12 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:12.861295 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-1b49c99a-b6e3-40aa-9bd9-f8644cf0e26e tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:12.861901 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-1b49c99a-b6e3-40aa-9bd9-f8644cf0e26e tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:12.869324 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1b49c99a-b6e3-40aa-9bd9-f8644cf0e26e tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:12.869773 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1b49c99a-b6e3-40aa-9bd9-f8644cf0e26e tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:12.870540 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1b49c99a-b6e3-40aa-9bd9-f8644cf0e26e tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:12.870983 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1b49c99a-b6e3-40aa-9bd9-f8644cf0e26e tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:13.012953 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-1b49c99a-b6e3-40aa-9bd9-f8644cf0e26e tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:13.020906 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-1b49c99a-b6e3-40aa-9bd9-f8644cf0e26e tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1756 microversion: 2.1 time: 0.163375 Jul 07 10:29:13.021611 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 216/411] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:12 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:13.840202 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-7c88401b-e249-4fe4-b0cd-db87a39051b2 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:13.840817 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-7c88401b-e249-4fe4-b0cd-db87a39051b2 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:13.847340 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7c88401b-e249-4fe4-b0cd-db87a39051b2 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:13.847816 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7c88401b-e249-4fe4-b0cd-db87a39051b2 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:13.848577 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7c88401b-e249-4fe4-b0cd-db87a39051b2 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:13.849017 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7c88401b-e249-4fe4-b0cd-db87a39051b2 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:13.976671 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-7c88401b-e249-4fe4-b0cd-db87a39051b2 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:13.984018 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-7c88401b-e249-4fe4-b0cd-db87a39051b2 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1258 microversion: 2.1 time: 0.147611 Jul 07 10:29:13.984577 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 196/412] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:13 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1258 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:14.038725 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-d42726c2-79b5-4938-99e7-48d200ae7a95 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:14.039364 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-d42726c2-79b5-4938-99e7-48d200ae7a95 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:14.045751 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d42726c2-79b5-4938-99e7-48d200ae7a95 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:14.046199 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d42726c2-79b5-4938-99e7-48d200ae7a95 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:14.046952 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d42726c2-79b5-4938-99e7-48d200ae7a95 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:14.047388 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d42726c2-79b5-4938-99e7-48d200ae7a95 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:14.200698 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-d42726c2-79b5-4938-99e7-48d200ae7a95 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:14.209868 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-d42726c2-79b5-4938-99e7-48d200ae7a95 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1756 microversion: 2.1 time: 0.174953 Jul 07 10:29:14.210614 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 217/413] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:14 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:15.000336 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6c7973f6-3c9c-452c-ac89-8cbbea421d6e tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:15.000948 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6c7973f6-3c9c-452c-ac89-8cbbea421d6e tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:15.007032 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6c7973f6-3c9c-452c-ac89-8cbbea421d6e tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:15.007489 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6c7973f6-3c9c-452c-ac89-8cbbea421d6e tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:15.008285 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6c7973f6-3c9c-452c-ac89-8cbbea421d6e tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:15.009048 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6c7973f6-3c9c-452c-ac89-8cbbea421d6e tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:15.143179 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6c7973f6-3c9c-452c-ac89-8cbbea421d6e tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:15.147238 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:29:15.152289 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6c7973f6-3c9c-452c-ac89-8cbbea421d6e tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1258 microversion: 2.1 time: 0.155827 Jul 07 10:29:15.152978 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 197/414] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:14 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:15.229556 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-c1383a7a-f661-4140-8c69-dbeb09bd69c9 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:15.230329 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-c1383a7a-f661-4140-8c69-dbeb09bd69c9 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:15.237560 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c1383a7a-f661-4140-8c69-dbeb09bd69c9 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:15.238137 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c1383a7a-f661-4140-8c69-dbeb09bd69c9 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:15.239006 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c1383a7a-f661-4140-8c69-dbeb09bd69c9 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:15.239543 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c1383a7a-f661-4140-8c69-dbeb09bd69c9 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:15.244915 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:29:15.393069 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-c1383a7a-f661-4140-8c69-dbeb09bd69c9 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:15.402238 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-c1383a7a-f661-4140-8c69-dbeb09bd69c9 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1756 microversion: 2.1 time: 0.178075 Jul 07 10:29:15.402953 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 218/415] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:15 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:16.173062 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ac10f8fd-9dbd-4690-9148-943ee5f71b75 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:16.173811 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ac10f8fd-9dbd-4690-9148-943ee5f71b75 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:16.183024 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ac10f8fd-9dbd-4690-9148-943ee5f71b75 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:16.183603 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ac10f8fd-9dbd-4690-9148-943ee5f71b75 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:16.184507 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ac10f8fd-9dbd-4690-9148-943ee5f71b75 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:16.185027 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ac10f8fd-9dbd-4690-9148-943ee5f71b75 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:16.354412 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ac10f8fd-9dbd-4690-9148-943ee5f71b75 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:16.365314 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ac10f8fd-9dbd-4690-9148-943ee5f71b75 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1258 microversion: 2.1 time: 0.198502 Jul 07 10:29:16.367345 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 198/416] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:16 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1258 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:16.421122 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-171b565c-9824-42f9-b37d-ee68c6aea991 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:16.421953 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-171b565c-9824-42f9-b37d-ee68c6aea991 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:16.429105 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-171b565c-9824-42f9-b37d-ee68c6aea991 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:16.429642 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-171b565c-9824-42f9-b37d-ee68c6aea991 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:16.430399 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-171b565c-9824-42f9-b37d-ee68c6aea991 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:16.430842 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-171b565c-9824-42f9-b37d-ee68c6aea991 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:16.596677 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-171b565c-9824-42f9-b37d-ee68c6aea991 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:16.607136 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-171b565c-9824-42f9-b37d-ee68c6aea991 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1756 microversion: 2.1 time: 0.189713 Jul 07 10:29:16.608470 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 219/417] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:16 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:17.384202 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e89ae4ac-dc56-4cd4-8f46-e470ec8041d7 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:17.384928 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e89ae4ac-dc56-4cd4-8f46-e470ec8041d7 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:17.391492 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e89ae4ac-dc56-4cd4-8f46-e470ec8041d7 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:17.392367 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e89ae4ac-dc56-4cd4-8f46-e470ec8041d7 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:17.393151 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e89ae4ac-dc56-4cd4-8f46-e470ec8041d7 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:17.393591 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e89ae4ac-dc56-4cd4-8f46-e470ec8041d7 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:17.423470 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-8ae9cf8a-b3b7-417a-8245-ffc14561833e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:17.424275 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-8ae9cf8a-b3b7-417a-8245-ffc14561833e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:17.431118 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8ae9cf8a-b3b7-417a-8245-ffc14561833e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:17.431813 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8ae9cf8a-b3b7-417a-8245-ffc14561833e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:17.432968 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8ae9cf8a-b3b7-417a-8245-ffc14561833e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:17.433481 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8ae9cf8a-b3b7-417a-8245-ffc14561833e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:17.572489 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e89ae4ac-dc56-4cd4-8f46-e470ec8041d7 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:17.581513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e89ae4ac-dc56-4cd4-8f46-e470ec8041d7 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1258 microversion: 2.1 time: 0.201663 Jul 07 10:29:17.582690 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 199/418] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:17 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1258 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:17.621848 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.objects.instance [None req-8ae9cf8a-b3b7-417a-8245-ffc14561833e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lazy-loading 'services' on Instance uuid ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 {{(pid=117646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 10:29:17.625735 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-812ff7c1-9614-4adb-9d9d-467d5e15b85c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:17.626872 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-812ff7c1-9614-4adb-9d9d-467d5e15b85c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:17.634524 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-812ff7c1-9614-4adb-9d9d-467d5e15b85c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:17.635395 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-812ff7c1-9614-4adb-9d9d-467d5e15b85c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:17.636658 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-812ff7c1-9614-4adb-9d9d-467d5e15b85c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:17.637364 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-812ff7c1-9614-4adb-9d9d-467d5e15b85c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:17.777230 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-8ae9cf8a-b3b7-417a-8245-ffc14561833e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6/os-volume_attachments/6c2f8237-fc28-4594-8737-7fd0729acb96" status: 202 len: 0 microversion: 2.1 time: 0.356990 Jul 07 10:29:17.778018 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 220/419] 10.222.0.16 () {58 vars in 1415 bytes} [Thu Jul 7 10:29:17 2022] DELETE /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6/os-volume_attachments/6c2f8237-fc28-4594-8737-7fd0729acb96 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 10:29:17.838039 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-812ff7c1-9614-4adb-9d9d-467d5e15b85c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:17.854069 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-812ff7c1-9614-4adb-9d9d-467d5e15b85c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1756 microversion: 2.1 time: 0.232337 Jul 07 10:29:17.854560 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 200/420] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:17 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1756 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:18.357044 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-2b91426c-9073-4f9a-9cb0-eafffdf4bfbe req-002a30c1-963e-4247-8978-443fb24c1864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3963fd-1a48-4f86-a15e-c4fbcadc5911", "name": "network-vif-plugged", "status": "completed", "tag": "52658524-0e22-481a-99ab-eb339029366f"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:29:18.366700 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-2b91426c-9073-4f9a-9cb0-eafffdf4bfbe req-002a30c1-963e-4247-8978-443fb24c1864 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:18.367411 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-2b91426c-9073-4f9a-9cb0-eafffdf4bfbe req-002a30c1-963e-4247-8978-443fb24c1864 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:18.385776 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-2b91426c-9073-4f9a-9cb0-eafffdf4bfbe req-002a30c1-963e-4247-8978-443fb24c1864 service nova] Creating event network-vif-plugged:52658524-0e22-481a-99ab-eb339029366f for instance 5f3963fd-1a48-4f86-a15e-c4fbcadc5911 on hv-cinder-82282 Jul 07 10:29:18.391686 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-2b91426c-9073-4f9a-9cb0-eafffdf4bfbe req-002a30c1-963e-4247-8978-443fb24c1864 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038905 Jul 07 10:29:18.393089 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 221/421] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:29:18.604031 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-7a035bc8-7d9c-40a8-8726-03f16f9a7019 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:18.604666 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-7a035bc8-7d9c-40a8-8726-03f16f9a7019 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:18.613088 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7a035bc8-7d9c-40a8-8726-03f16f9a7019 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:18.613545 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7a035bc8-7d9c-40a8-8726-03f16f9a7019 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:18.614329 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7a035bc8-7d9c-40a8-8726-03f16f9a7019 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:18.614766 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7a035bc8-7d9c-40a8-8726-03f16f9a7019 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:18.813298 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-7a035bc8-7d9c-40a8-8726-03f16f9a7019 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:18.821689 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-7a035bc8-7d9c-40a8-8726-03f16f9a7019 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1258 microversion: 2.1 time: 0.223575 Jul 07 10:29:18.822250 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 201/422] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:18 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1258 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:18.873659 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-2ad7e89f-e8a2-411b-b261-d66e522c593f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:18.874540 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-2ad7e89f-e8a2-411b-b261-d66e522c593f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:18.881965 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2ad7e89f-e8a2-411b-b261-d66e522c593f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:18.882545 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2ad7e89f-e8a2-411b-b261-d66e522c593f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:18.883421 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2ad7e89f-e8a2-411b-b261-d66e522c593f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:18.883991 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2ad7e89f-e8a2-411b-b261-d66e522c593f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:19.083774 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-2ad7e89f-e8a2-411b-b261-d66e522c593f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:19.092599 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-2ad7e89f-e8a2-411b-b261-d66e522c593f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1756 microversion: 2.1 time: 0.224463 Jul 07 10:29:19.093388 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 222/423] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:18 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1756 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:19.839118 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e7f6a02f-778f-4e3e-992c-9f05d565c285 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:19.841418 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e7f6a02f-778f-4e3e-992c-9f05d565c285 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:19.852882 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e7f6a02f-778f-4e3e-992c-9f05d565c285 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:19.853803 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e7f6a02f-778f-4e3e-992c-9f05d565c285 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:19.855677 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e7f6a02f-778f-4e3e-992c-9f05d565c285 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:19.856425 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e7f6a02f-778f-4e3e-992c-9f05d565c285 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:20.048696 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e7f6a02f-778f-4e3e-992c-9f05d565c285 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:20.050741 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-9f558f03-a2ad-44d5-bbf6-6ca51809d093 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:20.051911 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-9f558f03-a2ad-44d5-bbf6-6ca51809d093 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:20.060686 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9f558f03-a2ad-44d5-bbf6-6ca51809d093 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:20.066809 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e7f6a02f-778f-4e3e-992c-9f05d565c285 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1258 microversion: 2.1 time: 0.231613 Jul 07 10:29:20.067831 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9f558f03-a2ad-44d5-bbf6-6ca51809d093 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:20.068281 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 202/424] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:19 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1258 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:20.068692 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9f558f03-a2ad-44d5-bbf6-6ca51809d093 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:20.069359 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9f558f03-a2ad-44d5-bbf6-6ca51809d093 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:20.110483 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-006d175c-a1dd-46a4-95ce-4d9ce58f84b0 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:20.111287 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-006d175c-a1dd-46a4-95ce-4d9ce58f84b0 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:20.119583 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-006d175c-a1dd-46a4-95ce-4d9ce58f84b0 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:20.120256 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-006d175c-a1dd-46a4-95ce-4d9ce58f84b0 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:20.120380 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-9f558f03-a2ad-44d5-bbf6-6ca51809d093 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Going to try to terminate instance {{(pid=117646) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 10:29:20.121449 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-006d175c-a1dd-46a4-95ce-4d9ce58f84b0 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:20.122487 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-006d175c-a1dd-46a4-95ce-4d9ce58f84b0 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:20.232894 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-9f558f03-a2ad-44d5-bbf6-6ca51809d093 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6" status: 204 len: 0 microversion: 2.1 time: 0.185180 Jul 07 10:29:20.236599 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 223/425] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jul 7 10:29:20 2022] DELETE /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 10:29:20.247784 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-8d421f1f-4dbc-4f85-b7da-c667e2c696bb tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:20.248497 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-8d421f1f-4dbc-4f85-b7da-c667e2c696bb tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:20.259827 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8d421f1f-4dbc-4f85-b7da-c667e2c696bb tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:20.260530 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8d421f1f-4dbc-4f85-b7da-c667e2c696bb tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:20.261309 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8d421f1f-4dbc-4f85-b7da-c667e2c696bb tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:20.261763 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8d421f1f-4dbc-4f85-b7da-c667e2c696bb tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:20.314062 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-006d175c-a1dd-46a4-95ce-4d9ce58f84b0 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:20.328319 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-006d175c-a1dd-46a4-95ce-4d9ce58f84b0 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1759 microversion: 2.1 time: 0.222250 Jul 07 10:29:20.331815 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 203/426] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:20 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1759 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:20.533149 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-8d421f1f-4dbc-4f85-b7da-c667e2c696bb tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:20.543236 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-8d421f1f-4dbc-4f85-b7da-c667e2c696bb tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6" status: 200 len: 1513 microversion: 2.1 time: 0.302540 Jul 07 10:29:20.544415 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 224/427] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:20 2022] GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 => generated 1513 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:21.085152 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-905f342b-23a3-4721-8b31-22a4ec088c22 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:21.086519 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-905f342b-23a3-4721-8b31-22a4ec088c22 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:21.094049 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-905f342b-23a3-4721-8b31-22a4ec088c22 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:21.094622 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-905f342b-23a3-4721-8b31-22a4ec088c22 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:21.095607 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-905f342b-23a3-4721-8b31-22a4ec088c22 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:21.096068 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-905f342b-23a3-4721-8b31-22a4ec088c22 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:21.252422 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-905f342b-23a3-4721-8b31-22a4ec088c22 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:21.264389 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-905f342b-23a3-4721-8b31-22a4ec088c22 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1258 microversion: 2.1 time: 0.183228 Jul 07 10:29:21.265667 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 204/428] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:21 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1258 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:21.562228 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-2e9a7e76-9e08-4562-8618-9efb0af6c693 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:21.562831 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-2e9a7e76-9e08-4562-8618-9efb0af6c693 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:21.570345 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2e9a7e76-9e08-4562-8618-9efb0af6c693 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:21.570798 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2e9a7e76-9e08-4562-8618-9efb0af6c693 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:21.571562 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2e9a7e76-9e08-4562-8618-9efb0af6c693 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:21.572095 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2e9a7e76-9e08-4562-8618-9efb0af6c693 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:21.731285 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-2e9a7e76-9e08-4562-8618-9efb0af6c693 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:21.742990 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-2e9a7e76-9e08-4562-8618-9efb0af6c693 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6" status: 200 len: 1513 microversion: 2.1 time: 0.184466 Jul 07 10:29:21.745329 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 225/429] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:21 2022] GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:22.282920 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4d5f6ba0-ab4a-4297-a54b-3b19074aa26f tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:22.283556 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-4d5f6ba0-ab4a-4297-a54b-3b19074aa26f tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:22.292623 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4d5f6ba0-ab4a-4297-a54b-3b19074aa26f tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:22.293083 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4d5f6ba0-ab4a-4297-a54b-3b19074aa26f tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:22.295975 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4d5f6ba0-ab4a-4297-a54b-3b19074aa26f tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:22.296600 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4d5f6ba0-ab4a-4297-a54b-3b19074aa26f tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:22.564392 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-4d5f6ba0-ab4a-4297-a54b-3b19074aa26f tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:22.573012 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-4d5f6ba0-ab4a-4297-a54b-3b19074aa26f tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1441 microversion: 2.1 time: 0.294667 Jul 07 10:29:22.573586 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 205/430] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:22 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1441 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:22.590086 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-68e48f03-90b3-42b0-b8a8-93e72b5245e4 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:22.590828 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-68e48f03-90b3-42b0-b8a8-93e72b5245e4 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:22.597260 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-68e48f03-90b3-42b0-b8a8-93e72b5245e4 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:22.597917 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-68e48f03-90b3-42b0-b8a8-93e72b5245e4 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:22.598683 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-68e48f03-90b3-42b0-b8a8-93e72b5245e4 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:22.599118 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-68e48f03-90b3-42b0-b8a8-93e72b5245e4 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:22.761130 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-20960b02-22f2-4bda-b48b-7cc5fd2fb7e8 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:22.761744 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-20960b02-22f2-4bda-b48b-7cc5fd2fb7e8 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:22.767124 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-68e48f03-90b3-42b0-b8a8-93e72b5245e4 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:22.767855 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-20960b02-22f2-4bda-b48b-7cc5fd2fb7e8 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:22.769862 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-20960b02-22f2-4bda-b48b-7cc5fd2fb7e8 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:22.770821 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-20960b02-22f2-4bda-b48b-7cc5fd2fb7e8 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:22.772723 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-20960b02-22f2-4bda-b48b-7cc5fd2fb7e8 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:22.778432 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-68e48f03-90b3-42b0-b8a8-93e72b5245e4 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1441 microversion: 2.1 time: 0.192983 Jul 07 10:29:22.779018 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 226/431] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:22 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1441 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:23.210320 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-20960b02-22f2-4bda-b48b-7cc5fd2fb7e8 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:23.246436 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-20960b02-22f2-4bda-b48b-7cc5fd2fb7e8 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6" status: 200 len: 1513 microversion: 2.1 time: 0.488586 Jul 07 10:29:23.249001 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 206/432] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:22 2022] GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 => generated 1513 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:29:24.109745 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-22dcaa70-1e00-452b-a01f-2b0ba7da198e req-02fd08d3-0450-4c52-a88e-441ee63e5f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6", "name": "network-vif-deleted", "tag": "9e332fd9-fdcf-495a-9546-8197da03d874"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:29:24.120829 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:29:24.131426 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-22dcaa70-1e00-452b-a01f-2b0ba7da198e req-02fd08d3-0450-4c52-a88e-441ee63e5f3a service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:24.132212 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-22dcaa70-1e00-452b-a01f-2b0ba7da198e req-02fd08d3-0450-4c52-a88e-441ee63e5f3a service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:24.167251 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-22dcaa70-1e00-452b-a01f-2b0ba7da198e req-02fd08d3-0450-4c52-a88e-441ee63e5f3a service nova] Creating event network-vif-deleted:9e332fd9-fdcf-495a-9546-8197da03d874 for instance ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 on hv-cinder-82282 Jul 07 10:29:24.180516 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-22dcaa70-1e00-452b-a01f-2b0ba7da198e req-02fd08d3-0450-4c52-a88e-441ee63e5f3a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076944 Jul 07 10:29:24.181117 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 227/433] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:29:24.264400 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-98f78cf2-db94-4d91-a778-cbc4a59842aa tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:24.265018 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-98f78cf2-db94-4d91-a778-cbc4a59842aa tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:24.277807 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-98f78cf2-db94-4d91-a778-cbc4a59842aa tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:24.278266 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-98f78cf2-db94-4d91-a778-cbc4a59842aa tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:24.279092 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-98f78cf2-db94-4d91-a778-cbc4a59842aa tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:24.279534 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-98f78cf2-db94-4d91-a778-cbc4a59842aa tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:24.369118 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-98f78cf2-db94-4d91-a778-cbc4a59842aa tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:24.369581 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-98f78cf2-db94-4d91-a778-cbc4a59842aa tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:24.370041 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.objects.instance [None req-98f78cf2-db94-4d91-a778-cbc4a59842aa tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lazy-loading 'fault' on Instance uuid ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 {{(pid=117647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 10:29:24.450003 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-98f78cf2-db94-4d91-a778-cbc4a59842aa tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:24.458417 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-98f78cf2-db94-4d91-a778-cbc4a59842aa tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6" status: 200 len: 1309 microversion: 2.1 time: 0.197933 Jul 07 10:29:24.459511 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 207/434] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:24 2022] GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 => generated 1309 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:25.478620 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-4eecd6f2-6d84-4670-9eb0-591d2ffccc52 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:25.479892 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-4eecd6f2-6d84-4670-9eb0-591d2ffccc52 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:25.496027 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4eecd6f2-6d84-4670-9eb0-591d2ffccc52 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:25.501625 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4eecd6f2-6d84-4670-9eb0-591d2ffccc52 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:25.510919 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4eecd6f2-6d84-4670-9eb0-591d2ffccc52 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:25.519396 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4eecd6f2-6d84-4670-9eb0-591d2ffccc52 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:25.545831 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-97a440b8-3eee-430f-8861-f9bf1628e93b req-235d33b0-2624-44ca-ac34-0b8397cf6574 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f3963fd-1a48-4f86-a15e-c4fbcadc5911", "tag": "52658524-0e22-481a-99ab-eb339029366f"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:29:25.547408 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.wsgi [None req-4eecd6f2-6d84-4670-9eb0-591d2ffccc52 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] HTTP exception thrown: Instance ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 could not be found. Jul 07 10:29:25.549427 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-4eecd6f2-6d84-4670-9eb0-591d2ffccc52 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Request method failure captured: Jul 07 10:29:25.549427 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 HTTP/1.1 Jul 07 10:29:25.549427 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:29:25.549427 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:29:25.549427 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:29:25.549427 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 0 Jul 07 10:29:25.549427 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:29:25.549427 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:29:25.549427 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:29:25.549427 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:29:25.549427 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrUm_Oy3yGlX9SF_tMz1LYh8yqBOuEVVCyU4tEdZ0HGRLrnfpTlQ6YPnYzfiljzDTHiq7kfB-rwSYpSFho72AceNM4k1sssflWU6B4HSAKhtBZQzFuG3XJuUXEGDwIcoCOzos71Qs7007lTP1P299BMu0WVNfAh4D-RO1N5XTy1quYE Jul 07 10:29:25.549427 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:29:25.549427 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:29:25.549427 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:29:25.549427 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:29:25.549427 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:29:25.549427 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:29:25.549427 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: 1bd64979a2bc4ca6be57262f4387920e Jul 07 10:29:25.549427 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-VolumesSnapshotTestJSON-712313930 Jul 07 10:29:25.549427 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:29:25.549427 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:29:25.551033 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1bd64979a2bc4ca6be57262f4387920e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1bd64979a2bc4ca6be57262f4387920e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1bd64979a2bc4ca6be57262f4387920e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1bd64979a2bc4ca6be57262f4387920e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:29:25.551033 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-VolumesSnapshotTestJSON-712313930 Jul 07 10:29:25.551033 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: 1bd64979a2bc4ca6be57262f4387920e Jul 07 10:29:25.551033 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-712313930 Jul 07 10:29:25.551033 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-VolumesSnapshotTestJSON-712313930-project Jul 07 10:29:25.551033 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:29:25.551033 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:29:25.551033 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: 9476865e0b114996b2c0ffce9fca16a2 Jul 07 10:29:25.551033 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-VolumesSnapshotTestJSON-712313930-project Jul 07 10:29:25.551033 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: > Jul 07 10:29:25.551033 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Instance ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 could not be found. Jul 07 10:29:25.551033 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'id': 'ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6'} Jul 07 10:29:25.551989 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:29:25.551989 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:29:25.551989 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:29:25.551989 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:29:25.551989 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:29:25.551989 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:29:25.551989 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:29:25.551989 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:29:25.551989 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:29:25.551989 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:29:25.551989 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 could not be found. Jul 07 10:29:25.551989 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:29:25.551989 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:29:25.551989 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:29:25.551989 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:29:25.551989 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:29:25.551989 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:29:25.551989 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:29:25.551989 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:29:25.551989 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:29:25.554151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:29:25.554151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:29:25.554151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:29:25.554151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:29:25.554151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:29:25.554151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:29:25.554151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:29:25.554151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 could not be found. Jul 07 10:29:25.554151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:29:25.554151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:29:25.554151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:29:25.554151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:29:25.554151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:29:25.554151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:29:25.554151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:29:25.554151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:29:25.554151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 could not be found. Jul 07 10:29:25.554151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:29:25.555432 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:29:25.557438 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-4eecd6f2-6d84-4670-9eb0-591d2ffccc52 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Returning 404 to user: Instance ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 could not be found. {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:29:25.558412 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-4eecd6f2-6d84-4670-9eb0-591d2ffccc52 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6" status: 404 len: 111 microversion: 2.1 time: 0.085805 Jul 07 10:29:25.559015 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 228/435] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:25 2022] GET /compute/v2.1/servers/ad09d0ff-a0fd-4bef-9648-ad2f76ef57e6 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:29:25.561993 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-97a440b8-3eee-430f-8861-f9bf1628e93b req-235d33b0-2624-44ca-ac34-0b8397cf6574 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:25.562510 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-97a440b8-3eee-430f-8861-f9bf1628e93b req-235d33b0-2624-44ca-ac34-0b8397cf6574 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:25.590600 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-97a440b8-3eee-430f-8861-f9bf1628e93b req-235d33b0-2624-44ca-ac34-0b8397cf6574 service nova] Creating event network-changed:52658524-0e22-481a-99ab-eb339029366f for instance 5f3963fd-1a48-4f86-a15e-c4fbcadc5911 on hv-cinder-82282 Jul 07 10:29:25.596152 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-97a440b8-3eee-430f-8861-f9bf1628e93b req-235d33b0-2624-44ca-ac34-0b8397cf6574 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053837 Jul 07 10:29:25.596925 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 208/436] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:29:28.217182 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-d532fe2f-f57f-49bb-b7df-7749910eacf4 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Action: 'create', calling method: .version_select at 0x7f9e9e5f4af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-800154750", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHm8+jIB6x8qktCDUiHG6r8hGJmO2TV2vvcmJs8aQgTQqkOHm3yM/B8T7N54F/AGRV5TlJF2Nxa3U7DY+w+Trpe1dfr8abMdxMwxcqYvUpkt585QQmMche0TU1P/5F4nw=="}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:29:28.231695 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-d532fe2f-f57f-49bb-b7df-7749910eacf4 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Getting quotas for project 12a91d56e163442dacf4c5ce7b28a132. Resources: {'key_pairs'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:29:28.235712 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-d532fe2f-f57f-49bb-b7df-7749910eacf4 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Getting quotas for user 059a87a80fc547db8aeb3bb03003cd2c and project 12a91d56e163442dacf4c5ce7b28a132. Resources: {'key_pairs'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:29:28.259350 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-d532fe2f-f57f-49bb-b7df-7749910eacf4 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.253825 Jul 07 10:29:28.263834 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 229/437] 10.222.0.16 () {60 vars in 1158 bytes} [Thu Jul 7 10:29:28 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:29:28.975574 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-618c2c87-86cc-40fd-b108-f8a8a0b6a3af tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18922aeb-89a6-4ca9-8598-fdefb4ef3f64"}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:29:28.977652 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-618c2c87-86cc-40fd-b108-f8a8a0b6a3af tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:28.991360 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-618c2c87-86cc-40fd-b108-f8a8a0b6a3af tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:28.991838 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-618c2c87-86cc-40fd-b108-f8a8a0b6a3af tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:28.993752 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-618c2c87-86cc-40fd-b108-f8a8a0b6a3af tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:28.994363 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-618c2c87-86cc-40fd-b108-f8a8a0b6a3af tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:29.315809 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-618c2c87-86cc-40fd-b108-f8a8a0b6a3af tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "POST /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.346364 Jul 07 10:29:29.316467 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 209/438] 10.222.0.16 () {60 vars in 1322 bytes} [Thu Jul 7 10:29:28 2022] POST /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40/os-volume_attachments => generated 194 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:29:33.693261 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-3431d84c-fabc-4031-8753-ddb46af66c34 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:33.694339 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-3431d84c-fabc-4031-8753-ddb46af66c34 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:33.701764 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3431d84c-fabc-4031-8753-ddb46af66c34 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:33.702216 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3431d84c-fabc-4031-8753-ddb46af66c34 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:33.702973 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3431d84c-fabc-4031-8753-ddb46af66c34 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:33.703406 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3431d84c-fabc-4031-8753-ddb46af66c34 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:33.785446 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.objects.instance [None req-3431d84c-fabc-4031-8753-ddb46af66c34 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lazy-loading 'services' on Instance uuid b00a3c72-669b-41e2-a9b9-1a2921bcabe0 {{(pid=117646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 10:29:33.861476 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-3431d84c-fabc-4031-8753-ddb46af66c34 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0/os-volume_attachments/893fd455-c655-445b-a214-642b6a982dca" status: 202 len: 0 microversion: 2.1 time: 0.172961 Jul 07 10:29:33.862062 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 230/439] 10.222.0.16 () {58 vars in 1415 bytes} [Thu Jul 7 10:29:33 2022] DELETE /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0/os-volume_attachments/893fd455-c655-445b-a214-642b6a982dca => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 10:29:34.668443 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a52c6e27-d285-476a-a09e-7be0f685eb43 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-489088230", "imageRef": "1c96509d-f65f-42b0-94b3-6fc590a93508", "flavorRef": "452", "networks": [{"uuid": "b3e89720-1b64-4314-83e5-302338369447"}]}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:29:34.720910 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.network.neutron [None req-a52c6e27-d285-476a-a09e-7be0f685eb43 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] validate_networks() for [('b3e89720-1b64-4314-83e5-302338369447', None, None, None, None, None)] {{(pid=117647) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 10:29:35.067544 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-a52c6e27-d285-476a-a09e-7be0f685eb43 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Flavor limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 10:29:35.068030 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-a52c6e27-d285-476a-a09e-7be0f685eb43 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Image limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 10:29:35.068498 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-a52c6e27-d285-476a-a09e-7be0f685eb43 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Flavor pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 10:29:35.069542 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-a52c6e27-d285-476a-a09e-7be0f685eb43 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Image pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 10:29:35.070205 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-a52c6e27-d285-476a-a09e-7be0f685eb43 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 10:29:35.078895 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a52c6e27-d285-476a-a09e-7be0f685eb43 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:35.079337 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a52c6e27-d285-476a-a09e-7be0f685eb43 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:35.080152 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a52c6e27-d285-476a-a09e-7be0f685eb43 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:35.080588 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a52c6e27-d285-476a-a09e-7be0f685eb43 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:35.096673 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-a52c6e27-d285-476a-a09e-7be0f685eb43 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Getting quotas for project 1bd64979a2bc4ca6be57262f4387920e. Resources: {'cores', 'ram', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:29:35.100804 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-a52c6e27-d285-476a-a09e-7be0f685eb43 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Getting quotas for user 9476865e0b114996b2c0ffce9fca16a2 and project 1bd64979a2bc4ca6be57262f4387920e. Resources: {'cores', 'ram', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:29:35.112055 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a52c6e27-d285-476a-a09e-7be0f685eb43 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Going to run 1 instances... {{(pid=117647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 10:29:35.114445 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a52c6e27-d285-476a-a09e-7be0f685eb43 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: 169d7e71-dbcf-49c1-9f22-2e2fe854e9ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c96509d-f65f-42b0-94b3-6fc590a93508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 10:29:35.159894 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a52c6e27-d285-476a-a09e-7be0f685eb43 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.495631 Jul 07 10:29:35.160537 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 210/440] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jul 7 10:29:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 10:29:35.171022 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-df8aa922-a8e1-490c-88bc-a0f955f05656 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:35.171720 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-df8aa922-a8e1-490c-88bc-a0f955f05656 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: 169d7e71-dbcf-49c1-9f22-2e2fe854e9ab] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:35.227722 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-df8aa922-a8e1-490c-88bc-a0f955f05656 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:35.234744 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-df8aa922-a8e1-490c-88bc-a0f955f05656 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab" status: 200 len: 1218 microversion: 2.1 time: 0.067986 Jul 07 10:29:35.235400 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 231/441] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:35 2022] GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:36.252579 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-febb33a4-aca6-45f6-9231-030bb4a5fa7d tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:36.253116 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-febb33a4-aca6-45f6-9231-030bb4a5fa7d tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: 169d7e71-dbcf-49c1-9f22-2e2fe854e9ab] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:36.260545 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-febb33a4-aca6-45f6-9231-030bb4a5fa7d tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:36.261002 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-febb33a4-aca6-45f6-9231-030bb4a5fa7d tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:36.262026 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-febb33a4-aca6-45f6-9231-030bb4a5fa7d tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:36.262557 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-febb33a4-aca6-45f6-9231-030bb4a5fa7d tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:36.332377 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-febb33a4-aca6-45f6-9231-030bb4a5fa7d tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:36.342785 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-febb33a4-aca6-45f6-9231-030bb4a5fa7d tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab" status: 200 len: 1270 microversion: 2.1 time: 0.094327 Jul 07 10:29:36.343369 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 211/442] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:36 2022] GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab => generated 1270 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:36.861898 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-5d851544-a08e-4ce9-8804-809cdbb97333 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:29:36.862916 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-5d851544-a08e-4ce9-8804-809cdbb97333 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:36.875074 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5d851544-a08e-4ce9-8804-809cdbb97333 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:36.875527 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5d851544-a08e-4ce9-8804-809cdbb97333 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:36.876546 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5d851544-a08e-4ce9-8804-809cdbb97333 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:36.877169 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5d851544-a08e-4ce9-8804-809cdbb97333 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:36.899683 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.objects.instance [None req-5d851544-a08e-4ce9-8804-809cdbb97333 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lazy-loading 'flavor' on Instance uuid 5080ca5c-bf77-4305-877b-c992e9248b40 {{(pid=117646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 10:29:37.048273 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-5d851544-a08e-4ce9-8804-809cdbb97333 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "POST /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40/action" status: 200 len: 32 microversion: 2.1 time: 0.190513 Jul 07 10:29:37.049098 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 232/443] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Jul 7 10:29:36 2022] POST /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40/action => generated 32 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 10:29:37.059971 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-25d3f785-af94-412b-9305-b56f9d0495ac tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:37.060786 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-25d3f785-af94-412b-9305-b56f9d0495ac tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:37.068606 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-25d3f785-af94-412b-9305-b56f9d0495ac tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:37.069315 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-25d3f785-af94-412b-9305-b56f9d0495ac tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:37.071082 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-25d3f785-af94-412b-9305-b56f9d0495ac tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:37.071796 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-25d3f785-af94-412b-9305-b56f9d0495ac tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:37.141973 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a7c82a22-d5dd-45a2-ab29-b49c65d29187 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:29:37.152171 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a7c82a22-d5dd-45a2-ab29-b49c65d29187 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:37.152629 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a7c82a22-d5dd-45a2-ab29-b49c65d29187 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:37.177938 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-a7c82a22-d5dd-45a2-ab29-b49c65d29187 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Going to try to stop instance {{(pid=117646) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 07 10:29:37.204640 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:29:37.227053 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-a7c82a22-d5dd-45a2-ab29-b49c65d29187 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "POST /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0/action" status: 202 len: 0 microversion: 2.1 time: 0.088846 Jul 07 10:29:37.228165 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 233/444] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Jul 7 10:29:37 2022] POST /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 07 10:29:37.237019 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-e80b7ce7-8e18-4de6-9848-7e2d8a3b006e tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:37.237985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-e80b7ce7-8e18-4de6-9848-7e2d8a3b006e tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:37.245856 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e80b7ce7-8e18-4de6-9848-7e2d8a3b006e tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:37.246541 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e80b7ce7-8e18-4de6-9848-7e2d8a3b006e tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:37.247874 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e80b7ce7-8e18-4de6-9848-7e2d8a3b006e tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:37.248532 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e80b7ce7-8e18-4de6-9848-7e2d8a3b006e tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:37.377139 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-25d3f785-af94-412b-9305-b56f9d0495ac tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:37.391680 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-25d3f785-af94-412b-9305-b56f9d0495ac tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1735 microversion: 2.1 time: 0.336817 Jul 07 10:29:37.392903 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 212/445] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:37 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1735 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:37.399716 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9b4b881c-f6be-4b7f-8c6d-06c6439ac72e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:37.400739 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-9b4b881c-f6be-4b7f-8c6d-06c6439ac72e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: 169d7e71-dbcf-49c1-9f22-2e2fe854e9ab] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:37.407163 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9b4b881c-f6be-4b7f-8c6d-06c6439ac72e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:37.407626 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9b4b881c-f6be-4b7f-8c6d-06c6439ac72e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:37.408471 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9b4b881c-f6be-4b7f-8c6d-06c6439ac72e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:37.409071 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9b4b881c-f6be-4b7f-8c6d-06c6439ac72e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:37.448297 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-e80b7ce7-8e18-4de6-9848-7e2d8a3b006e tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:37.456633 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-e80b7ce7-8e18-4de6-9848-7e2d8a3b006e tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1678 microversion: 2.1 time: 0.223399 Jul 07 10:29:37.457218 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 234/446] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:37 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1678 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:37.490514 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9b4b881c-f6be-4b7f-8c6d-06c6439ac72e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:37.498675 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9b4b881c-f6be-4b7f-8c6d-06c6439ac72e tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab" status: 200 len: 1276 microversion: 2.1 time: 0.103464 Jul 07 10:29:37.499487 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 213/447] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:37 2022] GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab => generated 1276 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:38.373893 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-48c0af28-5732-44dc-beab-ef530b30024f req-7002e92f-d3fa-407d-b7b7-070f424a2167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "169d7e71-dbcf-49c1-9f22-2e2fe854e9ab", "tag": "6374acf9-967e-4103-9fea-a3e673c8bd19"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:29:38.385857 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-48c0af28-5732-44dc-beab-ef530b30024f req-7002e92f-d3fa-407d-b7b7-070f424a2167 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:38.386665 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-48c0af28-5732-44dc-beab-ef530b30024f req-7002e92f-d3fa-407d-b7b7-070f424a2167 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:38.399246 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-48c0af28-5732-44dc-beab-ef530b30024f req-7002e92f-d3fa-407d-b7b7-070f424a2167 service nova] Creating event network-changed:6374acf9-967e-4103-9fea-a3e673c8bd19 for instance 169d7e71-dbcf-49c1-9f22-2e2fe854e9ab on hv-cinder-82282 Jul 07 10:29:38.404053 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-48c0af28-5732-44dc-beab-ef530b30024f req-7002e92f-d3fa-407d-b7b7-070f424a2167 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034660 Jul 07 10:29:38.404904 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 235/448] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:29:38.410010 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0c9d0436-dbbe-40a3-900d-f4ace5a38895 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:38.410707 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0c9d0436-dbbe-40a3-900d-f4ace5a38895 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:38.418349 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0c9d0436-dbbe-40a3-900d-f4ace5a38895 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:38.418799 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0c9d0436-dbbe-40a3-900d-f4ace5a38895 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:38.419788 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0c9d0436-dbbe-40a3-900d-f4ace5a38895 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:38.420225 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0c9d0436-dbbe-40a3-900d-f4ace5a38895 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:38.425607 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:29:38.473968 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-e4b40c0d-6964-4fdc-8104-19a94f84d09b tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:38.474666 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-e4b40c0d-6964-4fdc-8104-19a94f84d09b tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:38.480971 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e4b40c0d-6964-4fdc-8104-19a94f84d09b tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:38.481424 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e4b40c0d-6964-4fdc-8104-19a94f84d09b tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:38.482196 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e4b40c0d-6964-4fdc-8104-19a94f84d09b tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:38.482637 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e4b40c0d-6964-4fdc-8104-19a94f84d09b tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:38.624381 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-e4b40c0d-6964-4fdc-8104-19a94f84d09b tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:38.634376 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-e4b40c0d-6964-4fdc-8104-19a94f84d09b tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1678 microversion: 2.1 time: 0.164595 Jul 07 10:29:38.635055 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 236/449] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:38 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:29:38.645390 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-fc40c5dc-f4af-485d-9114-a4547844838b tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:38.646116 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-fc40c5dc-f4af-485d-9114-a4547844838b tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: 169d7e71-dbcf-49c1-9f22-2e2fe854e9ab] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:38.655686 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fc40c5dc-f4af-485d-9114-a4547844838b tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:38.656194 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fc40c5dc-f4af-485d-9114-a4547844838b tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:38.656981 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fc40c5dc-f4af-485d-9114-a4547844838b tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:38.657421 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fc40c5dc-f4af-485d-9114-a4547844838b tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:38.804755 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-fc40c5dc-f4af-485d-9114-a4547844838b tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:38.812156 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-fc40c5dc-f4af-485d-9114-a4547844838b tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab" status: 200 len: 1318 microversion: 2.1 time: 0.171105 Jul 07 10:29:38.812722 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 237/450] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:38 2022] GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:38.926514 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0c9d0436-dbbe-40a3-900d-f4ace5a38895 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:38.934414 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0c9d0436-dbbe-40a3-900d-f4ace5a38895 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1735 microversion: 2.1 time: 0.528283 Jul 07 10:29:38.934980 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 214/451] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:38 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1735 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:39.652405 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-04456fe1-dcc8-4680-9107-10f19127ec05 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:39.653033 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-04456fe1-dcc8-4680-9107-10f19127ec05 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:39.659460 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-04456fe1-dcc8-4680-9107-10f19127ec05 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:39.659945 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-04456fe1-dcc8-4680-9107-10f19127ec05 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:39.660699 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-04456fe1-dcc8-4680-9107-10f19127ec05 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:39.661132 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-04456fe1-dcc8-4680-9107-10f19127ec05 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:39.793433 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-04456fe1-dcc8-4680-9107-10f19127ec05 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:39.800890 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-04456fe1-dcc8-4680-9107-10f19127ec05 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1678 microversion: 2.1 time: 0.152939 Jul 07 10:29:39.801458 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 238/452] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:39 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:39.829406 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-051f3bdf-9d1f-4d6c-b325-e80d2ae72759 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:39.830022 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-051f3bdf-9d1f-4d6c-b325-e80d2ae72759 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: 169d7e71-dbcf-49c1-9f22-2e2fe854e9ab] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:39.837141 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-051f3bdf-9d1f-4d6c-b325-e80d2ae72759 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:39.837593 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-051f3bdf-9d1f-4d6c-b325-e80d2ae72759 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:39.838350 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-051f3bdf-9d1f-4d6c-b325-e80d2ae72759 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:39.838787 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-051f3bdf-9d1f-4d6c-b325-e80d2ae72759 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:39.952228 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-fec2877a-4c24-4d53-bdeb-66e84dc4c359 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:39.952966 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-fec2877a-4c24-4d53-bdeb-66e84dc4c359 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:39.959321 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fec2877a-4c24-4d53-bdeb-66e84dc4c359 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:39.959888 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fec2877a-4c24-4d53-bdeb-66e84dc4c359 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:39.961319 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fec2877a-4c24-4d53-bdeb-66e84dc4c359 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:39.961845 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fec2877a-4c24-4d53-bdeb-66e84dc4c359 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:39.968779 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-051f3bdf-9d1f-4d6c-b325-e80d2ae72759 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:39.976617 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-051f3bdf-9d1f-4d6c-b325-e80d2ae72759 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab" status: 200 len: 1318 microversion: 2.1 time: 0.151073 Jul 07 10:29:39.977204 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 215/453] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:39 2022] GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:29:40.090880 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-fec2877a-4c24-4d53-bdeb-66e84dc4c359 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:40.099002 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-fec2877a-4c24-4d53-bdeb-66e84dc4c359 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1735 microversion: 2.1 time: 0.150840 Jul 07 10:29:40.099777 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 239/454] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:39 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:29:40.817845 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-7bca378a-92a9-4bf2-b712-cca0eb877f25 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:40.818457 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-7bca378a-92a9-4bf2-b712-cca0eb877f25 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:40.825333 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7bca378a-92a9-4bf2-b712-cca0eb877f25 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:40.825845 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7bca378a-92a9-4bf2-b712-cca0eb877f25 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:40.826623 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7bca378a-92a9-4bf2-b712-cca0eb877f25 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:40.827226 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7bca378a-92a9-4bf2-b712-cca0eb877f25 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:40.958076 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-7bca378a-92a9-4bf2-b712-cca0eb877f25 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:40.965551 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-7bca378a-92a9-4bf2-b712-cca0eb877f25 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1678 microversion: 2.1 time: 0.151552 Jul 07 10:29:40.966112 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 216/455] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:40 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:40.993905 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-61db2334-a2a8-48b4-9b2d-a738d509b815 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:40.994550 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-61db2334-a2a8-48b4-9b2d-a738d509b815 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: 169d7e71-dbcf-49c1-9f22-2e2fe854e9ab] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:41.000971 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-61db2334-a2a8-48b4-9b2d-a738d509b815 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:41.001428 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-61db2334-a2a8-48b4-9b2d-a738d509b815 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:41.002194 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-61db2334-a2a8-48b4-9b2d-a738d509b815 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:41.002637 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-61db2334-a2a8-48b4-9b2d-a738d509b815 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:41.115933 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-257ca2ce-00cc-48eb-91ac-03cfd2ba1250 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:41.116646 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-257ca2ce-00cc-48eb-91ac-03cfd2ba1250 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:41.122852 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-257ca2ce-00cc-48eb-91ac-03cfd2ba1250 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:41.123367 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-257ca2ce-00cc-48eb-91ac-03cfd2ba1250 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:41.124225 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-257ca2ce-00cc-48eb-91ac-03cfd2ba1250 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:41.124727 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-257ca2ce-00cc-48eb-91ac-03cfd2ba1250 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:41.134883 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-61db2334-a2a8-48b4-9b2d-a738d509b815 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:41.142406 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-61db2334-a2a8-48b4-9b2d-a738d509b815 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab" status: 200 len: 1318 microversion: 2.1 time: 0.152989 Jul 07 10:29:41.142969 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 240/456] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:40 2022] GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:41.264807 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-257ca2ce-00cc-48eb-91ac-03cfd2ba1250 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:41.274404 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-257ca2ce-00cc-48eb-91ac-03cfd2ba1250 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1735 microversion: 2.1 time: 0.162214 Jul 07 10:29:41.274990 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 217/457] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:41 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:29:41.982985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-438d14be-deac-46da-ba6b-05d1541b0c76 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:41.983594 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-438d14be-deac-46da-ba6b-05d1541b0c76 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:41.989654 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-438d14be-deac-46da-ba6b-05d1541b0c76 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:41.990101 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-438d14be-deac-46da-ba6b-05d1541b0c76 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:41.990855 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-438d14be-deac-46da-ba6b-05d1541b0c76 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:41.991291 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-438d14be-deac-46da-ba6b-05d1541b0c76 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:42.117509 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-438d14be-deac-46da-ba6b-05d1541b0c76 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:42.125049 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-438d14be-deac-46da-ba6b-05d1541b0c76 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1678 microversion: 2.1 time: 0.145921 Jul 07 10:29:42.125608 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 241/458] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:41 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:42.160151 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-43499e19-779a-4f66-96e5-774768373bb2 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:42.160760 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-43499e19-779a-4f66-96e5-774768373bb2 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: 169d7e71-dbcf-49c1-9f22-2e2fe854e9ab] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:42.167576 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-43499e19-779a-4f66-96e5-774768373bb2 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:42.168061 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-43499e19-779a-4f66-96e5-774768373bb2 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:42.168809 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-43499e19-779a-4f66-96e5-774768373bb2 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:42.169240 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-43499e19-779a-4f66-96e5-774768373bb2 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:42.291725 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-2c2b04c6-c2d8-4422-80ab-472c529fa4f6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:42.292607 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-2c2b04c6-c2d8-4422-80ab-472c529fa4f6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:42.294970 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-43499e19-779a-4f66-96e5-774768373bb2 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:42.298709 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2c2b04c6-c2d8-4422-80ab-472c529fa4f6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:42.299242 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2c2b04c6-c2d8-4422-80ab-472c529fa4f6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:42.300054 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2c2b04c6-c2d8-4422-80ab-472c529fa4f6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:42.300502 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2c2b04c6-c2d8-4422-80ab-472c529fa4f6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:42.302810 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-43499e19-779a-4f66-96e5-774768373bb2 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab" status: 200 len: 1318 microversion: 2.1 time: 0.146670 Jul 07 10:29:42.303463 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 218/459] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:42 2022] GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:42.430728 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-2c2b04c6-c2d8-4422-80ab-472c529fa4f6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:42.438527 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-2c2b04c6-c2d8-4422-80ab-472c529fa4f6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1735 microversion: 2.1 time: 0.151329 Jul 07 10:29:42.439088 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 242/460] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:42 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:29:43.141901 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c9b1a4fa-07f0-475c-b99c-35f4c5bef6a7 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:43.142442 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c9b1a4fa-07f0-475c-b99c-35f4c5bef6a7 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:43.148385 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c9b1a4fa-07f0-475c-b99c-35f4c5bef6a7 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:43.148829 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c9b1a4fa-07f0-475c-b99c-35f4c5bef6a7 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:43.149606 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c9b1a4fa-07f0-475c-b99c-35f4c5bef6a7 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:43.150037 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c9b1a4fa-07f0-475c-b99c-35f4c5bef6a7 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:43.280804 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c9b1a4fa-07f0-475c-b99c-35f4c5bef6a7 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:43.288222 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c9b1a4fa-07f0-475c-b99c-35f4c5bef6a7 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1678 microversion: 2.1 time: 0.150115 Jul 07 10:29:43.289465 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 219/461] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:43 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:43.320048 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-31b71987-24a3-447d-9c8a-2bfcdcb0ae7a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:43.320751 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-31b71987-24a3-447d-9c8a-2bfcdcb0ae7a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: 169d7e71-dbcf-49c1-9f22-2e2fe854e9ab] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:43.327340 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-31b71987-24a3-447d-9c8a-2bfcdcb0ae7a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:43.327842 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-31b71987-24a3-447d-9c8a-2bfcdcb0ae7a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:43.328620 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-31b71987-24a3-447d-9c8a-2bfcdcb0ae7a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:43.329062 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-31b71987-24a3-447d-9c8a-2bfcdcb0ae7a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:43.455541 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0027bd5c-9389-4b07-a9d3-23469644b6c9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:43.456280 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0027bd5c-9389-4b07-a9d3-23469644b6c9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:43.461138 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-31b71987-24a3-447d-9c8a-2bfcdcb0ae7a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:43.462961 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0027bd5c-9389-4b07-a9d3-23469644b6c9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:43.463409 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0027bd5c-9389-4b07-a9d3-23469644b6c9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:43.464202 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0027bd5c-9389-4b07-a9d3-23469644b6c9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:43.464640 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0027bd5c-9389-4b07-a9d3-23469644b6c9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:43.468444 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-31b71987-24a3-447d-9c8a-2bfcdcb0ae7a tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab" status: 200 len: 1318 microversion: 2.1 time: 0.152578 Jul 07 10:29:43.469004 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 243/462] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:43 2022] GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:43.591293 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0027bd5c-9389-4b07-a9d3-23469644b6c9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:43.599287 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0027bd5c-9389-4b07-a9d3-23469644b6c9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1735 microversion: 2.1 time: 0.147514 Jul 07 10:29:43.599887 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 220/463] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:43 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:29:44.306097 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a271208f-870f-44bd-b841-c63dd78ee70d tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:44.306624 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-a271208f-870f-44bd-b841-c63dd78ee70d tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:44.312658 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a271208f-870f-44bd-b841-c63dd78ee70d tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:44.313135 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a271208f-870f-44bd-b841-c63dd78ee70d tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:44.313886 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a271208f-870f-44bd-b841-c63dd78ee70d tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:44.314317 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a271208f-870f-44bd-b841-c63dd78ee70d tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:44.439730 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-a271208f-870f-44bd-b841-c63dd78ee70d tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:44.447580 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-a271208f-870f-44bd-b841-c63dd78ee70d tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1678 microversion: 2.1 time: 0.145476 Jul 07 10:29:44.448263 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 244/464] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:44 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:44.485080 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-72cc6a6b-e812-4861-8290-12f089eb6baf tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:44.485709 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-72cc6a6b-e812-4861-8290-12f089eb6baf tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: 169d7e71-dbcf-49c1-9f22-2e2fe854e9ab] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:44.492498 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-72cc6a6b-e812-4861-8290-12f089eb6baf tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:44.492947 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-72cc6a6b-e812-4861-8290-12f089eb6baf tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:44.493699 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-72cc6a6b-e812-4861-8290-12f089eb6baf tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:44.494131 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-72cc6a6b-e812-4861-8290-12f089eb6baf tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:44.617030 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-19c463f6-1405-4daf-882f-1a5a3a486477 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:44.617634 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-19c463f6-1405-4daf-882f-1a5a3a486477 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:44.620441 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-72cc6a6b-e812-4861-8290-12f089eb6baf tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:44.623679 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-19c463f6-1405-4daf-882f-1a5a3a486477 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:44.624164 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-19c463f6-1405-4daf-882f-1a5a3a486477 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:44.624923 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-19c463f6-1405-4daf-882f-1a5a3a486477 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:44.625353 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-19c463f6-1405-4daf-882f-1a5a3a486477 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:44.627948 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-72cc6a6b-e812-4861-8290-12f089eb6baf tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab" status: 200 len: 1318 microversion: 2.1 time: 0.146595 Jul 07 10:29:44.628547 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 221/465] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:44 2022] GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:44.754251 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-19c463f6-1405-4daf-882f-1a5a3a486477 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:44.762174 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-19c463f6-1405-4daf-882f-1a5a3a486477 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1735 microversion: 2.1 time: 0.149485 Jul 07 10:29:44.762742 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 245/466] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:44 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:29:44.886865 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-03a28896-c7dc-4fe6-8725-83648b35ded4 req-f227722f-c7dd-4c74-9549-c2175ced4ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "169d7e71-dbcf-49c1-9f22-2e2fe854e9ab", "name": "network-vif-plugged", "status": "completed", "tag": "6374acf9-967e-4103-9fea-a3e673c8bd19"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:29:44.895510 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-03a28896-c7dc-4fe6-8725-83648b35ded4 req-f227722f-c7dd-4c74-9549-c2175ced4ef3 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:44.895991 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-03a28896-c7dc-4fe6-8725-83648b35ded4 req-f227722f-c7dd-4c74-9549-c2175ced4ef3 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:44.906908 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-03a28896-c7dc-4fe6-8725-83648b35ded4 req-f227722f-c7dd-4c74-9549-c2175ced4ef3 service nova] Creating event network-vif-plugged:6374acf9-967e-4103-9fea-a3e673c8bd19 for instance 169d7e71-dbcf-49c1-9f22-2e2fe854e9ab on hv-cinder-82282 Jul 07 10:29:44.912060 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-03a28896-c7dc-4fe6-8725-83648b35ded4 req-f227722f-c7dd-4c74-9549-c2175ced4ef3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029450 Jul 07 10:29:44.912732 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 222/467] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 10:29:45.465296 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-c60bbd15-6145-40b9-b82a-b11b81319236 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:45.465929 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-c60bbd15-6145-40b9-b82a-b11b81319236 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:45.468008 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell0:SELECT=6 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:29:45.474683 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c60bbd15-6145-40b9-b82a-b11b81319236 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:45.475345 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c60bbd15-6145-40b9-b82a-b11b81319236 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:45.477086 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c60bbd15-6145-40b9-b82a-b11b81319236 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:45.477682 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c60bbd15-6145-40b9-b82a-b11b81319236 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:45.608293 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-c60bbd15-6145-40b9-b82a-b11b81319236 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:45.615728 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-c60bbd15-6145-40b9-b82a-b11b81319236 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1678 microversion: 2.1 time: 0.154459 Jul 07 10:29:45.616310 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 246/468] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:45 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:45.642513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:29:45.643266 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=6 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:29:45.648924 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a20ece71-d222-4f03-8b51-2a834c42e0da tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:45.649608 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a20ece71-d222-4f03-8b51-2a834c42e0da tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: 169d7e71-dbcf-49c1-9f22-2e2fe854e9ab] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:45.656576 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a20ece71-d222-4f03-8b51-2a834c42e0da tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:45.657020 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a20ece71-d222-4f03-8b51-2a834c42e0da tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:45.657767 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a20ece71-d222-4f03-8b51-2a834c42e0da tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:45.658196 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a20ece71-d222-4f03-8b51-2a834c42e0da tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:45.779592 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-6cdb7c22-c755-4084-97bc-89389e41a2e5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:45.780250 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-6cdb7c22-c755-4084-97bc-89389e41a2e5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:45.786672 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6cdb7c22-c755-4084-97bc-89389e41a2e5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:45.786896 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a20ece71-d222-4f03-8b51-2a834c42e0da tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:45.787134 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6cdb7c22-c755-4084-97bc-89389e41a2e5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:45.788084 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6cdb7c22-c755-4084-97bc-89389e41a2e5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:45.788553 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6cdb7c22-c755-4084-97bc-89389e41a2e5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:45.795326 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a20ece71-d222-4f03-8b51-2a834c42e0da tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab" status: 200 len: 1318 microversion: 2.1 time: 0.153671 Jul 07 10:29:45.795929 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 223/469] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:45 2022] GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:45.919518 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-6cdb7c22-c755-4084-97bc-89389e41a2e5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:45.927472 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-6cdb7c22-c755-4084-97bc-89389e41a2e5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1735 microversion: 2.1 time: 0.152038 Jul 07 10:29:45.928066 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 247/470] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:45 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:29:46.633277 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-46a47fdb-2d7b-4b3c-9ae2-14e962dff257 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:46.633893 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-46a47fdb-2d7b-4b3c-9ae2-14e962dff257 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:46.639907 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-46a47fdb-2d7b-4b3c-9ae2-14e962dff257 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:46.640363 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-46a47fdb-2d7b-4b3c-9ae2-14e962dff257 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:46.641236 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-46a47fdb-2d7b-4b3c-9ae2-14e962dff257 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:46.641561 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-46a47fdb-2d7b-4b3c-9ae2-14e962dff257 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:46.692286 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-881c5659-b8ce-4929-bdad-6e79240f3125 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1968946138", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-800154750", "security_groups": [{"name": "tempest-secgroup-smoke-51530022"}], "block_device_mapping_v2": [{"uuid": "faf59746-87c7-41ff-9011-1af885e44e0a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "06199cd4-69ed-4b3c-bfad-2ede6bfd3a79"}]}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:29:46.782360 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-46a47fdb-2d7b-4b3c-9ae2-14e962dff257 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:46.789817 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-46a47fdb-2d7b-4b3c-9ae2-14e962dff257 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1678 microversion: 2.1 time: 0.160954 Jul 07 10:29:46.790383 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 224/471] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:46 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:46.812101 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a7e8e105-acbd-448c-b4a0-6bcc228953b3 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:46.812251 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.network.neutron [None req-881c5659-b8ce-4929-bdad-6e79240f3125 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] validate_networks() for [('06199cd4-69ed-4b3c-bfad-2ede6bfd3a79', None, None, None, None, None)] {{(pid=117646) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 10:29:46.812853 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a7e8e105-acbd-448c-b4a0-6bcc228953b3 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: 169d7e71-dbcf-49c1-9f22-2e2fe854e9ab] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:46.821546 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a7e8e105-acbd-448c-b4a0-6bcc228953b3 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:46.822084 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a7e8e105-acbd-448c-b4a0-6bcc228953b3 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:46.822920 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a7e8e105-acbd-448c-b4a0-6bcc228953b3 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:46.823419 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a7e8e105-acbd-448c-b4a0-6bcc228953b3 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:46.967524 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a7e8e105-acbd-448c-b4a0-6bcc228953b3 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:46.975068 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a7e8e105-acbd-448c-b4a0-6bcc228953b3 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab" status: 200 len: 1318 microversion: 2.1 time: 0.166974 Jul 07 10:29:46.975634 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 225/472] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:46 2022] GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:29:46.980303 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1c31c030-e174-4007-96fb-b9c289e73b04 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:46.980911 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1c31c030-e174-4007-96fb-b9c289e73b04 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:46.986752 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1c31c030-e174-4007-96fb-b9c289e73b04 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:46.987207 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1c31c030-e174-4007-96fb-b9c289e73b04 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:46.988003 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1c31c030-e174-4007-96fb-b9c289e73b04 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:46.988442 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1c31c030-e174-4007-96fb-b9c289e73b04 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:47.119692 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-1c31c030-e174-4007-96fb-b9c289e73b04 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:47.127640 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1c31c030-e174-4007-96fb-b9c289e73b04 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1735 microversion: 2.1 time: 0.150818 Jul 07 10:29:47.128231 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 226/473] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:46 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:47.185313 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-881c5659-b8ce-4929-bdad-6e79240f3125 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Flavor limits 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 10:29:47.185740 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-881c5659-b8ce-4929-bdad-6e79240f3125 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Image limits 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 10:29:47.186220 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-881c5659-b8ce-4929-bdad-6e79240f3125 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Flavor pref 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 10:29:47.186630 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-881c5659-b8ce-4929-bdad-6e79240f3125 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Image pref 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 10:29:47.187045 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-881c5659-b8ce-4929-bdad-6e79240f3125 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 10:29:47.196212 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-881c5659-b8ce-4929-bdad-6e79240f3125 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:47.196667 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-881c5659-b8ce-4929-bdad-6e79240f3125 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:47.197472 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-881c5659-b8ce-4929-bdad-6e79240f3125 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:47.197914 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-881c5659-b8ce-4929-bdad-6e79240f3125 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:47.214263 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-881c5659-b8ce-4929-bdad-6e79240f3125 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Getting quotas for project 12a91d56e163442dacf4c5ce7b28a132. Resources: {'cores', 'ram', 'instances'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:29:47.218247 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-881c5659-b8ce-4929-bdad-6e79240f3125 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Getting quotas for user 059a87a80fc547db8aeb3bb03003cd2c and project 12a91d56e163442dacf4c5ce7b28a132. Resources: {'cores', 'ram', 'instances'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:29:47.274522 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-881c5659-b8ce-4929-bdad-6e79240f3125 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Going to run 1 instances... {{(pid=117646) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 10:29:47.276640 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-881c5659-b8ce-4929-bdad-6e79240f3125 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='faf59746-87c7-41ff-9011-1af885e44e0a',volume_size=None,volume_type=None)] {{(pid=117646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 10:29:47.406968 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-881c5659-b8ce-4929-bdad-6e79240f3125 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.718420 Jul 07 10:29:47.407618 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 248/474] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jul 7 10:29:46 2022] POST /compute/v2.1/servers => generated 404 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 07 10:29:47.417869 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8f836b7c-3cbc-43b6-83db-6c9bfd89ceb2 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:47.418580 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8f836b7c-3cbc-43b6-83db-6c9bfd89ceb2 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:47.471491 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8f836b7c-3cbc-43b6-83db-6c9bfd89ceb2 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:47.478175 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8f836b7c-3cbc-43b6-83db-6c9bfd89ceb2 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428" status: 200 len: 1094 microversion: 2.1 time: 0.064271 Jul 07 10:29:47.478863 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 227/475] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:47 2022] GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:29:47.809869 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-01119e9e-e23a-41b1-9e7e-946adfd5e7c2 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:47.815508 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-01119e9e-e23a-41b1-9e7e-946adfd5e7c2 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:47.823444 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-01119e9e-e23a-41b1-9e7e-946adfd5e7c2 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:47.823948 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-01119e9e-e23a-41b1-9e7e-946adfd5e7c2 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:47.825263 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-01119e9e-e23a-41b1-9e7e-946adfd5e7c2 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:47.825857 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-01119e9e-e23a-41b1-9e7e-946adfd5e7c2 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:47.955894 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-01119e9e-e23a-41b1-9e7e-946adfd5e7c2 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:47.963281 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-01119e9e-e23a-41b1-9e7e-946adfd5e7c2 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1678 microversion: 2.1 time: 0.157314 Jul 07 10:29:47.964118 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 249/476] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:47 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:47.992291 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-266d667a-2d3a-4a67-a2e9-e530981b5084 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:47.992894 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-266d667a-2d3a-4a67-a2e9-e530981b5084 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: 169d7e71-dbcf-49c1-9f22-2e2fe854e9ab] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:47.999545 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-266d667a-2d3a-4a67-a2e9-e530981b5084 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:48.000035 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-266d667a-2d3a-4a67-a2e9-e530981b5084 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:48.000812 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-266d667a-2d3a-4a67-a2e9-e530981b5084 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:48.001252 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-266d667a-2d3a-4a67-a2e9-e530981b5084 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:48.129117 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-266d667a-2d3a-4a67-a2e9-e530981b5084 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:48.137092 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-266d667a-2d3a-4a67-a2e9-e530981b5084 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab" status: 200 len: 1505 microversion: 2.1 time: 0.149330 Jul 07 10:29:48.137660 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 228/477] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:47 2022] GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:48.146190 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-c29dc9e7-3575-4e0f-8195-0266fc8b613f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:48.146803 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-c29dc9e7-3575-4e0f-8195-0266fc8b613f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:48.153481 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-410d4701-4ec6-4d10-b813-559b45694d4c tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53fbaa9d-f5f5-42a5-8439-97913e0734f8", "device": "/dev/sdb"}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:29:48.153674 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c29dc9e7-3575-4e0f-8195-0266fc8b613f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:48.154088 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c29dc9e7-3575-4e0f-8195-0266fc8b613f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:48.154854 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c29dc9e7-3575-4e0f-8195-0266fc8b613f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:48.155086 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-410d4701-4ec6-4d10-b813-559b45694d4c tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: 169d7e71-dbcf-49c1-9f22-2e2fe854e9ab] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:48.155538 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c29dc9e7-3575-4e0f-8195-0266fc8b613f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:48.161355 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-410d4701-4ec6-4d10-b813-559b45694d4c tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:48.161812 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-410d4701-4ec6-4d10-b813-559b45694d4c tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:48.162718 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-410d4701-4ec6-4d10-b813-559b45694d4c tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:48.163180 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-410d4701-4ec6-4d10-b813-559b45694d4c tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:48.294309 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-c29dc9e7-3575-4e0f-8195-0266fc8b613f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:48.297753 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:29:48.303046 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-c29dc9e7-3575-4e0f-8195-0266fc8b613f tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1735 microversion: 2.1 time: 0.160697 Jul 07 10:29:48.303613 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 250/478] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:48 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:48.497073 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-b0fdaf7d-bd9a-4743-b44c-77530c3eb0c7 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:48.497958 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-b0fdaf7d-bd9a-4743-b44c-77530c3eb0c7 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:48.505170 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b0fdaf7d-bd9a-4743-b44c-77530c3eb0c7 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:48.505854 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b0fdaf7d-bd9a-4743-b44c-77530c3eb0c7 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:48.506798 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b0fdaf7d-bd9a-4743-b44c-77530c3eb0c7 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:48.507835 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b0fdaf7d-bd9a-4743-b44c-77530c3eb0c7 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:48.574811 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-410d4701-4ec6-4d10-b813-559b45694d4c tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "POST /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.425012 Jul 07 10:29:48.575847 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 229/479] 10.222.0.16 () {60 vars in 1322 bytes} [Thu Jul 7 10:29:48 2022] POST /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab/os-volume_attachments => generated 194 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 10:29:48.583571 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-b0fdaf7d-bd9a-4743-b44c-77530c3eb0c7 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:48.595286 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-b0fdaf7d-bd9a-4743-b44c-77530c3eb0c7 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428" status: 200 len: 1200 microversion: 2.1 time: 0.104407 Jul 07 10:29:48.598299 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 251/480] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:48 2022] GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 => generated 1200 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:29:48.982650 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-21a538c3-4347-44c1-960f-7c31323767e8 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:48.983383 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-21a538c3-4347-44c1-960f-7c31323767e8 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:48.991335 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-21a538c3-4347-44c1-960f-7c31323767e8 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:48.992068 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-21a538c3-4347-44c1-960f-7c31323767e8 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:48.993093 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-21a538c3-4347-44c1-960f-7c31323767e8 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:48.993921 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-21a538c3-4347-44c1-960f-7c31323767e8 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:49.213834 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-21a538c3-4347-44c1-960f-7c31323767e8 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:49.223569 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-21a538c3-4347-44c1-960f-7c31323767e8 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1678 microversion: 2.1 time: 0.245779 Jul 07 10:29:49.224180 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 230/481] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:48 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1678 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:49.320404 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-6b64de63-5324-4254-a41d-4f11300397d0 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:49.321022 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-6b64de63-5324-4254-a41d-4f11300397d0 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:49.328979 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6b64de63-5324-4254-a41d-4f11300397d0 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:49.329910 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6b64de63-5324-4254-a41d-4f11300397d0 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:49.330846 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6b64de63-5324-4254-a41d-4f11300397d0 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:49.331433 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6b64de63-5324-4254-a41d-4f11300397d0 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:49.474799 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-6b64de63-5324-4254-a41d-4f11300397d0 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:49.483121 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-6b64de63-5324-4254-a41d-4f11300397d0 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1735 microversion: 2.1 time: 0.167173 Jul 07 10:29:49.483697 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 252/482] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:49 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:49.613939 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-79b52e6d-7e13-4966-a1d7-b16bfa4370e5 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:49.614754 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-79b52e6d-7e13-4966-a1d7-b16bfa4370e5 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:49.626495 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-79b52e6d-7e13-4966-a1d7-b16bfa4370e5 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:49.627019 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-79b52e6d-7e13-4966-a1d7-b16bfa4370e5 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:49.627819 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-79b52e6d-7e13-4966-a1d7-b16bfa4370e5 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:49.628254 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-79b52e6d-7e13-4966-a1d7-b16bfa4370e5 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:49.633162 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:29:49.821976 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-79b52e6d-7e13-4966-a1d7-b16bfa4370e5 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:49.829806 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-79b52e6d-7e13-4966-a1d7-b16bfa4370e5 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428" status: 200 len: 1264 microversion: 2.1 time: 0.220794 Jul 07 10:29:49.839455 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 231/483] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:49 2022] GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 => generated 1264 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:50.092337 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-19c98b48-1543-409a-9232-6a115db53c77 req-6d69c7a7-89be-4f20-b202-e112a5374ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2364e764-0c0a-493f-bc92-2f8701294428", "tag": "552f5d9a-f502-4184-a7a5-3082829225b5"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:29:50.101694 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-19c98b48-1543-409a-9232-6a115db53c77 req-6d69c7a7-89be-4f20-b202-e112a5374ba5 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:50.102248 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-19c98b48-1543-409a-9232-6a115db53c77 req-6d69c7a7-89be-4f20-b202-e112a5374ba5 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:50.122075 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-19c98b48-1543-409a-9232-6a115db53c77 req-6d69c7a7-89be-4f20-b202-e112a5374ba5 service nova] Creating event network-changed:552f5d9a-f502-4184-a7a5-3082829225b5 for instance 2364e764-0c0a-493f-bc92-2f8701294428 on hv-cinder-82282 Jul 07 10:29:50.127671 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-19c98b48-1543-409a-9232-6a115db53c77 req-6d69c7a7-89be-4f20-b202-e112a5374ba5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041483 Jul 07 10:29:50.128929 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 253/484] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:29:50.241106 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-42f7ace0-0e5e-4cad-b640-c276826a5fe4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:50.242330 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-42f7ace0-0e5e-4cad-b640-c276826a5fe4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:50.250182 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-42f7ace0-0e5e-4cad-b640-c276826a5fe4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:50.250640 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-42f7ace0-0e5e-4cad-b640-c276826a5fe4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:50.251430 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-42f7ace0-0e5e-4cad-b640-c276826a5fe4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:50.251958 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-42f7ace0-0e5e-4cad-b640-c276826a5fe4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:50.468458 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-42f7ace0-0e5e-4cad-b640-c276826a5fe4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:50.475944 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-42f7ace0-0e5e-4cad-b640-c276826a5fe4 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1678 microversion: 2.1 time: 0.238830 Jul 07 10:29:50.476565 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 232/485] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:50 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1678 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:50.501078 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-95d8d24d-5594-4c5f-95e2-47eee789b290 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:50.502334 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-95d8d24d-5594-4c5f-95e2-47eee789b290 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:50.510863 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-95d8d24d-5594-4c5f-95e2-47eee789b290 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:50.511312 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-95d8d24d-5594-4c5f-95e2-47eee789b290 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:50.512127 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-95d8d24d-5594-4c5f-95e2-47eee789b290 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:50.512565 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-95d8d24d-5594-4c5f-95e2-47eee789b290 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:50.846339 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8802657b-796c-4324-97c6-93970b30738e tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:50.846948 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8802657b-796c-4324-97c6-93970b30738e tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:50.853807 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8802657b-796c-4324-97c6-93970b30738e tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:50.854499 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8802657b-796c-4324-97c6-93970b30738e tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:50.855347 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8802657b-796c-4324-97c6-93970b30738e tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:50.855883 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8802657b-796c-4324-97c6-93970b30738e tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:50.856541 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-95d8d24d-5594-4c5f-95e2-47eee789b290 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:50.865689 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-95d8d24d-5594-4c5f-95e2-47eee789b290 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1735 microversion: 2.1 time: 0.369192 Jul 07 10:29:50.866766 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 254/486] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:50 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1735 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:51.069271 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8802657b-796c-4324-97c6-93970b30738e tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:51.077908 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8802657b-796c-4324-97c6-93970b30738e tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428" status: 200 len: 1264 microversion: 2.1 time: 0.235378 Jul 07 10:29:51.078488 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 233/487] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:50 2022] GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 => generated 1264 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:29:51.493646 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a2f962c5-2a12-4fbd-9b8d-1380fe3df792 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:51.494268 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-a2f962c5-2a12-4fbd-9b8d-1380fe3df792 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:51.501394 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a2f962c5-2a12-4fbd-9b8d-1380fe3df792 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:51.502189 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a2f962c5-2a12-4fbd-9b8d-1380fe3df792 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:51.503038 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a2f962c5-2a12-4fbd-9b8d-1380fe3df792 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:51.503713 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a2f962c5-2a12-4fbd-9b8d-1380fe3df792 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:51.634037 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-a2f962c5-2a12-4fbd-9b8d-1380fe3df792 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:51.641452 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-a2f962c5-2a12-4fbd-9b8d-1380fe3df792 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1678 microversion: 2.1 time: 0.152429 Jul 07 10:29:51.642009 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 255/488] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:51 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:51.883344 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8ce834fa-9270-427d-bb5f-b77f8d42b804 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:51.883971 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8ce834fa-9270-427d-bb5f-b77f8d42b804 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:51.890337 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8ce834fa-9270-427d-bb5f-b77f8d42b804 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:51.890781 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8ce834fa-9270-427d-bb5f-b77f8d42b804 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:51.891535 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8ce834fa-9270-427d-bb5f-b77f8d42b804 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:51.891993 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8ce834fa-9270-427d-bb5f-b77f8d42b804 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:52.079275 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8ce834fa-9270-427d-bb5f-b77f8d42b804 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:52.087697 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8ce834fa-9270-427d-bb5f-b77f8d42b804 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1735 microversion: 2.1 time: 0.208363 Jul 07 10:29:52.088298 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 234/489] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:51 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1735 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:52.094218 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-67813831-8b8b-4194-8407-e22949297b5a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:52.094913 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-67813831-8b8b-4194-8407-e22949297b5a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:52.101579 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-67813831-8b8b-4194-8407-e22949297b5a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:52.102035 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-67813831-8b8b-4194-8407-e22949297b5a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:52.102800 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-67813831-8b8b-4194-8407-e22949297b5a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:52.103242 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-67813831-8b8b-4194-8407-e22949297b5a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:52.233826 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-67813831-8b8b-4194-8407-e22949297b5a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:52.241208 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-67813831-8b8b-4194-8407-e22949297b5a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428" status: 200 len: 1264 microversion: 2.1 time: 0.150834 Jul 07 10:29:52.241774 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 256/490] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:52 2022] GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:52.658355 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1247b49c-3284-4d14-8c8b-e8f2256567e0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:52.658967 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1247b49c-3284-4d14-8c8b-e8f2256567e0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:52.665004 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1247b49c-3284-4d14-8c8b-e8f2256567e0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:52.665454 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1247b49c-3284-4d14-8c8b-e8f2256567e0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:52.666219 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1247b49c-3284-4d14-8c8b-e8f2256567e0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:52.666680 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1247b49c-3284-4d14-8c8b-e8f2256567e0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:52.792544 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-1247b49c-3284-4d14-8c8b-e8f2256567e0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:52.799932 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1247b49c-3284-4d14-8c8b-e8f2256567e0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1655 microversion: 2.1 time: 0.145446 Jul 07 10:29:52.800492 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 235/491] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:52 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1655 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:52.816086 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-60997b0f-b8ce-4425-a282-cd190a519870 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:29:52.822642 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-60997b0f-b8ce-4425-a282-cd190a519870 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:52.823096 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-60997b0f-b8ce-4425-a282-cd190a519870 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:52.845308 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-60997b0f-b8ce-4425-a282-cd190a519870 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Going to try to start instance {{(pid=117646) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 07 10:29:52.886013 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-60997b0f-b8ce-4425-a282-cd190a519870 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "POST /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0/action" status: 202 len: 0 microversion: 2.1 time: 0.073504 Jul 07 10:29:52.886608 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 257/492] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Jul 7 10:29:52 2022] POST /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 10:29:52.894904 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ea68ff9b-e19e-4d93-8382-dd6bec933a49 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:52.895521 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ea68ff9b-e19e-4d93-8382-dd6bec933a49 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:52.902573 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ea68ff9b-e19e-4d93-8382-dd6bec933a49 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:52.903242 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ea68ff9b-e19e-4d93-8382-dd6bec933a49 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:52.904037 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ea68ff9b-e19e-4d93-8382-dd6bec933a49 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:52.904639 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ea68ff9b-e19e-4d93-8382-dd6bec933a49 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:53.063984 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ea68ff9b-e19e-4d93-8382-dd6bec933a49 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:53.072150 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ea68ff9b-e19e-4d93-8382-dd6bec933a49 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1664 microversion: 2.1 time: 0.181041 Jul 07 10:29:53.072738 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 236/493] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:52 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1664 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:53.106081 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-8fb42aa1-8e1e-4123-8e5e-2920528d39de tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:53.106777 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-8fb42aa1-8e1e-4123-8e5e-2920528d39de tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:53.113641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8fb42aa1-8e1e-4123-8e5e-2920528d39de tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:53.114208 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8fb42aa1-8e1e-4123-8e5e-2920528d39de tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:53.115067 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8fb42aa1-8e1e-4123-8e5e-2920528d39de tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:53.115587 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8fb42aa1-8e1e-4123-8e5e-2920528d39de tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:53.254780 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-8fb42aa1-8e1e-4123-8e5e-2920528d39de tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:53.257675 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-cf0dec56-ab65-4cbf-9421-0a75a19a8e9a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:53.258301 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-cf0dec56-ab65-4cbf-9421-0a75a19a8e9a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:53.262706 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-8fb42aa1-8e1e-4123-8e5e-2920528d39de tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1735 microversion: 2.1 time: 0.161797 Jul 07 10:29:53.263270 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 258/494] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:53 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:53.264249 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cf0dec56-ab65-4cbf-9421-0a75a19a8e9a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:53.264705 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cf0dec56-ab65-4cbf-9421-0a75a19a8e9a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:53.265476 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cf0dec56-ab65-4cbf-9421-0a75a19a8e9a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:53.265918 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cf0dec56-ab65-4cbf-9421-0a75a19a8e9a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:53.398242 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-cf0dec56-ab65-4cbf-9421-0a75a19a8e9a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:53.405648 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-cf0dec56-ab65-4cbf-9421-0a75a19a8e9a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428" status: 200 len: 1264 microversion: 2.1 time: 0.151908 Jul 07 10:29:53.406216 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 237/495] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:53 2022] GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:29:54.089761 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-4e7ed814-c335-4414-974c-df1f5720dac3 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:54.090379 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-4e7ed814-c335-4414-974c-df1f5720dac3 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:54.096434 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4e7ed814-c335-4414-974c-df1f5720dac3 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:54.096886 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4e7ed814-c335-4414-974c-df1f5720dac3 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:54.097651 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4e7ed814-c335-4414-974c-df1f5720dac3 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:54.098094 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4e7ed814-c335-4414-974c-df1f5720dac3 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:54.229188 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-4e7ed814-c335-4414-974c-df1f5720dac3 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:54.236626 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-4e7ed814-c335-4414-974c-df1f5720dac3 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1664 microversion: 2.1 time: 0.150745 Jul 07 10:29:54.237188 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 259/496] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:54 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1664 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:54.279716 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-cf0c8fbb-8be2-4ec7-b21e-1759310c71fe tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:54.280348 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-cf0c8fbb-8be2-4ec7-b21e-1759310c71fe tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:54.286931 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cf0c8fbb-8be2-4ec7-b21e-1759310c71fe tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:54.287384 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cf0c8fbb-8be2-4ec7-b21e-1759310c71fe tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:54.288189 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cf0c8fbb-8be2-4ec7-b21e-1759310c71fe tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:54.288623 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cf0c8fbb-8be2-4ec7-b21e-1759310c71fe tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:54.422588 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-b94a3787-1aff-4a3f-9809-0c8f1a170744 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:54.423518 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-b94a3787-1aff-4a3f-9809-0c8f1a170744 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:54.430411 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b94a3787-1aff-4a3f-9809-0c8f1a170744 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:54.430986 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b94a3787-1aff-4a3f-9809-0c8f1a170744 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:54.432069 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b94a3787-1aff-4a3f-9809-0c8f1a170744 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:54.432623 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b94a3787-1aff-4a3f-9809-0c8f1a170744 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:54.467202 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-cf0c8fbb-8be2-4ec7-b21e-1759310c71fe tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:54.477499 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-cf0c8fbb-8be2-4ec7-b21e-1759310c71fe tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1735 microversion: 2.1 time: 0.201543 Jul 07 10:29:54.478081 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 238/497] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:54 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1735 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:54.631294 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-b94a3787-1aff-4a3f-9809-0c8f1a170744 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:54.639246 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-b94a3787-1aff-4a3f-9809-0c8f1a170744 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428" status: 200 len: 1264 microversion: 2.1 time: 0.220892 Jul 07 10:29:54.640193 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 260/498] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:54 2022] GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 => generated 1264 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:29:55.253811 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-fc27ff2e-9f96-4df6-9991-de753452c746 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:55.254349 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-fc27ff2e-9f96-4df6-9991-de753452c746 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:55.260387 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fc27ff2e-9f96-4df6-9991-de753452c746 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:55.260842 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fc27ff2e-9f96-4df6-9991-de753452c746 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:55.261599 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fc27ff2e-9f96-4df6-9991-de753452c746 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:55.262028 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fc27ff2e-9f96-4df6-9991-de753452c746 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:55.395347 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-fc27ff2e-9f96-4df6-9991-de753452c746 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:55.402788 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-fc27ff2e-9f96-4df6-9991-de753452c746 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1664 microversion: 2.1 time: 0.152929 Jul 07 10:29:55.403387 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 239/499] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:55 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1664 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:55.494941 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-5eb7fd06-78e8-4ed0-b937-821986834c10 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:55.495557 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-5eb7fd06-78e8-4ed0-b937-821986834c10 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:55.498020 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:29:55.503300 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5eb7fd06-78e8-4ed0-b937-821986834c10 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:55.503776 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5eb7fd06-78e8-4ed0-b937-821986834c10 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:55.504607 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5eb7fd06-78e8-4ed0-b937-821986834c10 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:55.505003 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5eb7fd06-78e8-4ed0-b937-821986834c10 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:55.635438 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-5eb7fd06-78e8-4ed0-b937-821986834c10 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:55.643303 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-5eb7fd06-78e8-4ed0-b937-821986834c10 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1735 microversion: 2.1 time: 0.152810 Jul 07 10:29:55.643894 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 261/500] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:55 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:55.656295 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0ff37b20-8137-4a1a-a848-5b53ad493adb tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:55.656899 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0ff37b20-8137-4a1a-a848-5b53ad493adb tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:55.662806 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0ff37b20-8137-4a1a-a848-5b53ad493adb tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:55.663266 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0ff37b20-8137-4a1a-a848-5b53ad493adb tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:55.664064 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0ff37b20-8137-4a1a-a848-5b53ad493adb tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:55.664498 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0ff37b20-8137-4a1a-a848-5b53ad493adb tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:55.792642 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0ff37b20-8137-4a1a-a848-5b53ad493adb tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:55.800161 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0ff37b20-8137-4a1a-a848-5b53ad493adb tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428" status: 200 len: 1264 microversion: 2.1 time: 0.147563 Jul 07 10:29:55.800731 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 240/501] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:55 2022] GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:56.419921 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-158f7c85-80bd-4d25-a07d-1f1cba854c10 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:56.420556 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-158f7c85-80bd-4d25-a07d-1f1cba854c10 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:56.427065 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-158f7c85-80bd-4d25-a07d-1f1cba854c10 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:56.427508 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-158f7c85-80bd-4d25-a07d-1f1cba854c10 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:56.428311 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-158f7c85-80bd-4d25-a07d-1f1cba854c10 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:56.429419 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-158f7c85-80bd-4d25-a07d-1f1cba854c10 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:56.558538 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-158f7c85-80bd-4d25-a07d-1f1cba854c10 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:56.566874 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-158f7c85-80bd-4d25-a07d-1f1cba854c10 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1664 microversion: 2.1 time: 0.150819 Jul 07 10:29:56.567457 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 262/502] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:56 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1664 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:56.660639 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-bb65ae19-52fe-40bc-898b-0ab5eec669c4 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:56.661237 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-bb65ae19-52fe-40bc-898b-0ab5eec669c4 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:56.668388 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bb65ae19-52fe-40bc-898b-0ab5eec669c4 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:56.668843 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bb65ae19-52fe-40bc-898b-0ab5eec669c4 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:56.669612 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bb65ae19-52fe-40bc-898b-0ab5eec669c4 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:56.670362 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bb65ae19-52fe-40bc-898b-0ab5eec669c4 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:56.806473 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-bb65ae19-52fe-40bc-898b-0ab5eec669c4 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:56.816957 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-bb65ae19-52fe-40bc-898b-0ab5eec669c4 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1715 microversion: 2.1 time: 0.160205 Jul 07 10:29:56.817152 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-541c391e-8890-4990-a052-835bca611c16 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:56.817523 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 241/503] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:56 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1715 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:56.817684 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-541c391e-8890-4990-a052-835bca611c16 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:56.824533 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-541c391e-8890-4990-a052-835bca611c16 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:56.824995 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-541c391e-8890-4990-a052-835bca611c16 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:56.825768 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-541c391e-8890-4990-a052-835bca611c16 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:56.826211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-541c391e-8890-4990-a052-835bca611c16 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:56.919703 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9abbb026-8785-4d9a-b385-7dde43dbdf76 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:56.920225 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-9abbb026-8785-4d9a-b385-7dde43dbdf76 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:56.926186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9abbb026-8785-4d9a-b385-7dde43dbdf76 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:56.926575 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9abbb026-8785-4d9a-b385-7dde43dbdf76 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:56.927340 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9abbb026-8785-4d9a-b385-7dde43dbdf76 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:56.927865 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9abbb026-8785-4d9a-b385-7dde43dbdf76 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:56.961406 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-541c391e-8890-4990-a052-835bca611c16 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:56.968877 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-541c391e-8890-4990-a052-835bca611c16 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428" status: 200 len: 1264 microversion: 2.1 time: 0.155623 Jul 07 10:29:56.969447 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 263/504] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:56 2022] GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:29:57.050259 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-9abbb026-8785-4d9a-b385-7dde43dbdf76 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] HTTP exception thrown: Cannot 'detach_volume' instance 5080ca5c-bf77-4305-877b-c992e9248b40 while it is in vm_state rescued Jul 07 10:29:57.051926 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9abbb026-8785-4d9a-b385-7dde43dbdf76 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Request method failure captured: Jul 07 10:29:57.051926 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: request: DELETE /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40/os-volume_attachments/18922aeb-89a6-4ca9-8598-fdefb4ef3f64 HTTP/1.1 Jul 07 10:29:57.051926 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept: application/json Jul 07 10:29:57.051926 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jul 07 10:29:57.051926 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Connection: close Jul 07 10:29:57.051926 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jul 07 10:29:57.051926 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jul 07 10:29:57.051926 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Host: 10.222.0.16 Jul 07 10:29:57.051926 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jul 07 10:29:57.051926 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jul 07 10:29:57.051926 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABixrS4oJkiQJ2S1nuTus8_u0pgmHtb2UVNyGp6_ugxW7QSRm-iSt8LOJAKl2ypHUM-taYWb6Bei6nHqf_-zMcUYULB9JjdSQtGpTGJBQ6G69lQK9O9rW3T1MeoKBWymStKrelTWl9C3QobvGGNXcuc-HNij8n2XMYSmetxBRApxPwJ7WE Jul 07 10:29:57.051926 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jul 07 10:29:57.051926 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jul 07 10:29:57.051926 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jul 07 10:29:57.051926 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jul 07 10:29:57.051926 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jul 07 10:29:57.051926 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jul 07 10:29:57.051926 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Id: 0a883b49db0f4f32a32bf6d87e2f6104 Jul 07 10:29:57.051926 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1851522730 Jul 07 10:29:57.051926 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jul 07 10:29:57.051926 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jul 07 10:29:57.054016 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a883b49db0f4f32a32bf6d87e2f6104"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0a883b49db0f4f32a32bf6d87e2f6104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a883b49db0f4f32a32bf6d87e2f6104"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0a883b49db0f4f32a32bf6d87e2f6104"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:29:57.054016 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1851522730 Jul 07 10:29:57.054016 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 0a883b49db0f4f32a32bf6d87e2f6104 Jul 07 10:29:57.054016 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1851522730 Jul 07 10:29:57.054016 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User: tempest-ServerRescueNegativeTestJSON-1851522730-project Jul 07 10:29:57.054016 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jul 07 10:29:57.054016 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jul 07 10:29:57.054016 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Id: 92b758b22f054dd991e8af99354a134f Jul 07 10:29:57.054016 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1851522730-project Jul 07 10:29:57.054016 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: method: > Jul 07 10:29:57.054016 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: exception: Cannot 'detach_volume' instance 5080ca5c-bf77-4305-877b-c992e9248b40 while it is in vm_state rescued Jul 07 10:29:57.054833 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: action_args: {'server_id': '5080ca5c-bf77-4305-877b-c992e9248b40', 'id': '18922aeb-89a6-4ca9-8598-fdefb4ef3f64'} Jul 07 10:29:57.054833 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:29:57.054833 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:29:57.054833 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 07 10:29:57.054833 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 07 10:29:57.054833 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 07 10:29:57.054833 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 07 10:29:57.054833 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 07 10:29:57.054833 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 07 10:29:57.054833 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5080ca5c-bf77-4305-877b-c992e9248b40 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 07 10:29:57.054833 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:29:57.054833 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:29:57.054833 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:29:57.054833 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:29:57.054833 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:29:57.054833 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:29:57.054833 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:29:57.054833 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:29:57.054833 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:29:57.054833 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:29:57.056285 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 07 10:29:57.056285 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 07 10:29:57.056285 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 07 10:29:57.056285 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 07 10:29:57.056285 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5080ca5c-bf77-4305-877b-c992e9248b40 while it is in vm_state rescued Jul 07 10:29:57.056285 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:29:57.056285 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:29:57.056285 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:29:57.056285 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:29:57.056285 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:29:57.056285 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:29:57.056285 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:29:57.056285 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:29:57.056285 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5080ca5c-bf77-4305-877b-c992e9248b40 while it is in vm_state rescued Jul 07 10:29:57.056285 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:29:57.056285 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9abbb026-8785-4d9a-b385-7dde43dbdf76 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Returning 409 to user: Cannot 'detach_volume' instance 5080ca5c-bf77-4305-877b-c992e9248b40 while it is in vm_state rescued {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:29:57.057449 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9abbb026-8785-4d9a-b385-7dde43dbdf76 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40/os-volume_attachments/18922aeb-89a6-4ca9-8598-fdefb4ef3f64" status: 409 len: 152 microversion: 2.1 time: 0.137590 Jul 07 10:29:57.057449 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 242/505] 10.222.0.16 () {58 vars in 1415 bytes} [Thu Jul 7 10:29:56 2022] DELETE /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40/os-volume_attachments/18922aeb-89a6-4ca9-8598-fdefb4ef3f64 => generated 152 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 07 10:29:57.062907 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-cf4e1545-0c4e-4705-9310-9cda9d6f3124 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:29:57.063440 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-cf4e1545-0c4e-4705-9310-9cda9d6f3124 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:57.069550 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-cf4e1545-0c4e-4705-9310-9cda9d6f3124 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:57.070258 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-cf4e1545-0c4e-4705-9310-9cda9d6f3124 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:57.071040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-cf4e1545-0c4e-4705-9310-9cda9d6f3124 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:57.071470 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-cf4e1545-0c4e-4705-9310-9cda9d6f3124 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:57.134498 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-cf4e1545-0c4e-4705-9310-9cda9d6f3124 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "POST /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40/action" status: 202 len: 0 microversion: 2.1 time: 0.075088 Jul 07 10:29:57.137882 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 264/506] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Jul 7 10:29:57 2022] POST /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 10:29:57.143244 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-20df921f-7473-4778-970f-366b2c6201e9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:57.143880 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-20df921f-7473-4778-970f-366b2c6201e9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:57.150509 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-20df921f-7473-4778-970f-366b2c6201e9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:57.150951 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-20df921f-7473-4778-970f-366b2c6201e9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:57.151704 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-20df921f-7473-4778-970f-366b2c6201e9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:57.152160 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-20df921f-7473-4778-970f-366b2c6201e9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:57.280564 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-20df921f-7473-4778-970f-366b2c6201e9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:57.289691 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-20df921f-7473-4778-970f-366b2c6201e9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1723 microversion: 2.1 time: 0.150401 Jul 07 10:29:57.290254 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 243/507] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:57 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:57.586097 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-aa596001-b01d-4a79-9edc-0b165a14705c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:57.586784 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-aa596001-b01d-4a79-9edc-0b165a14705c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:57.588721 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell0:SELECT=2 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:29:57.589400 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell0:SELECT=6 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:29:57.595783 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-aa596001-b01d-4a79-9edc-0b165a14705c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:57.596236 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-aa596001-b01d-4a79-9edc-0b165a14705c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:57.596990 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-aa596001-b01d-4a79-9edc-0b165a14705c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:57.597429 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-aa596001-b01d-4a79-9edc-0b165a14705c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:57.723338 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-aa596001-b01d-4a79-9edc-0b165a14705c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:57.731477 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-aa596001-b01d-4a79-9edc-0b165a14705c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1668 microversion: 2.1 time: 0.149684 Jul 07 10:29:57.732285 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 265/508] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:57 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1668 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:57.985583 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b625f5d6-1b9d-4ffa-a6ae-be1aacfe449a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:57.986202 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b625f5d6-1b9d-4ffa-a6ae-be1aacfe449a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:57.988042 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:29:57.993793 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b625f5d6-1b9d-4ffa-a6ae-be1aacfe449a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:57.994186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b625f5d6-1b9d-4ffa-a6ae-be1aacfe449a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:57.994946 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b625f5d6-1b9d-4ffa-a6ae-be1aacfe449a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:57.995386 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b625f5d6-1b9d-4ffa-a6ae-be1aacfe449a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:58.124860 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b625f5d6-1b9d-4ffa-a6ae-be1aacfe449a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:58.132899 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b625f5d6-1b9d-4ffa-a6ae-be1aacfe449a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428" status: 200 len: 1264 microversion: 2.1 time: 0.151243 Jul 07 10:29:58.133520 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 244/509] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:57 2022] GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:29:58.307514 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-f5477db0-1ef0-4d4b-ac99-5ff0377f7da6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:58.308173 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-f5477db0-1ef0-4d4b-ac99-5ff0377f7da6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:58.314200 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f5477db0-1ef0-4d4b-ac99-5ff0377f7da6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:58.314648 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f5477db0-1ef0-4d4b-ac99-5ff0377f7da6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:58.315408 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f5477db0-1ef0-4d4b-ac99-5ff0377f7da6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:58.315928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f5477db0-1ef0-4d4b-ac99-5ff0377f7da6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:58.321011 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:29:58.450224 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-f5477db0-1ef0-4d4b-ac99-5ff0377f7da6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:58.458028 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-f5477db0-1ef0-4d4b-ac99-5ff0377f7da6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1723 microversion: 2.1 time: 0.155280 Jul 07 10:29:58.458590 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 266/510] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:58 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:59.149362 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-09471541-ee16-40b8-929f-0af3a49ac54d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:59.149972 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-09471541-ee16-40b8-929f-0af3a49ac54d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:59.152329 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:29:59.157593 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-09471541-ee16-40b8-929f-0af3a49ac54d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:59.158044 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-09471541-ee16-40b8-929f-0af3a49ac54d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:59.158803 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-09471541-ee16-40b8-929f-0af3a49ac54d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:59.159237 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-09471541-ee16-40b8-929f-0af3a49ac54d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:59.299407 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-09471541-ee16-40b8-929f-0af3a49ac54d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:59.307994 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-09471541-ee16-40b8-929f-0af3a49ac54d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428" status: 200 len: 1264 microversion: 2.1 time: 0.162426 Jul 07 10:29:59.308562 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 245/511] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:59 2022] GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:29:59.474397 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-fa1bba61-8b1a-40c1-bd44-f881371524ae tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:29:59.474969 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-fa1bba61-8b1a-40c1-bd44-f881371524ae tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:29:59.481376 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fa1bba61-8b1a-40c1-bd44-f881371524ae tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:59.481823 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fa1bba61-8b1a-40c1-bd44-f881371524ae tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:59.482571 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fa1bba61-8b1a-40c1-bd44-f881371524ae tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:29:59.483021 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fa1bba61-8b1a-40c1-bd44-f881371524ae tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:29:59.608032 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-fa1bba61-8b1a-40c1-bd44-f881371524ae tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:29:59.616351 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-fa1bba61-8b1a-40c1-bd44-f881371524ae tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1723 microversion: 2.1 time: 0.145346 Jul 07 10:29:59.616911 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 267/512] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:29:59 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:00.325128 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-589a2f9c-7f3b-4af8-b0c5-2ead34a5a981 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:00.325736 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-589a2f9c-7f3b-4af8-b0c5-2ead34a5a981 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:00.332327 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-589a2f9c-7f3b-4af8-b0c5-2ead34a5a981 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:00.332702 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-589a2f9c-7f3b-4af8-b0c5-2ead34a5a981 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:00.333459 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-589a2f9c-7f3b-4af8-b0c5-2ead34a5a981 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:00.333886 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-589a2f9c-7f3b-4af8-b0c5-2ead34a5a981 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:00.465298 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-589a2f9c-7f3b-4af8-b0c5-2ead34a5a981 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:00.472807 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-589a2f9c-7f3b-4af8-b0c5-2ead34a5a981 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428" status: 200 len: 1264 microversion: 2.1 time: 0.151629 Jul 07 10:30:00.473371 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 246/513] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:00 2022] GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:00.634517 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-bd9a2613-917d-4041-b2bf-491bbc267065 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:00.635061 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-bd9a2613-917d-4041-b2bf-491bbc267065 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:00.641495 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bd9a2613-917d-4041-b2bf-491bbc267065 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:00.641952 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bd9a2613-917d-4041-b2bf-491bbc267065 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:00.642719 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bd9a2613-917d-4041-b2bf-491bbc267065 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:00.643157 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bd9a2613-917d-4041-b2bf-491bbc267065 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:00.767264 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-bd9a2613-917d-4041-b2bf-491bbc267065 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:00.775188 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-bd9a2613-917d-4041-b2bf-491bbc267065 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1723 microversion: 2.1 time: 0.145187 Jul 07 10:30:00.775772 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 268/514] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:00 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:01.489537 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-54221015-f1a7-4572-a590-39b4ae463b79 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:01.490182 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-54221015-f1a7-4572-a590-39b4ae463b79 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:01.497592 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-54221015-f1a7-4572-a590-39b4ae463b79 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:01.498042 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-54221015-f1a7-4572-a590-39b4ae463b79 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:01.498797 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-54221015-f1a7-4572-a590-39b4ae463b79 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:01.499229 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-54221015-f1a7-4572-a590-39b4ae463b79 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:01.633547 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-54221015-f1a7-4572-a590-39b4ae463b79 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:01.637365 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=100 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:30:01.642767 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-54221015-f1a7-4572-a590-39b4ae463b79 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428" status: 200 len: 1264 microversion: 2.1 time: 0.156992 Jul 07 10:30:01.643610 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 247/515] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:01 2022] GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:01.793257 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-16a99d4b-08d8-46ea-909e-f363facab7b9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:01.793876 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-16a99d4b-08d8-46ea-909e-f363facab7b9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:01.800510 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-16a99d4b-08d8-46ea-909e-f363facab7b9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:01.801256 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-16a99d4b-08d8-46ea-909e-f363facab7b9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:01.802266 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-16a99d4b-08d8-46ea-909e-f363facab7b9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:01.802913 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-16a99d4b-08d8-46ea-909e-f363facab7b9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:01.943906 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-16a99d4b-08d8-46ea-909e-f363facab7b9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:01.952359 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-16a99d4b-08d8-46ea-909e-f363facab7b9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1723 microversion: 2.1 time: 0.163589 Jul 07 10:30:01.952930 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 269/516] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:01 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:02.659388 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5544741c-88fd-4a7f-9321-927fcce85315 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:02.660019 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5544741c-88fd-4a7f-9321-927fcce85315 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:02.666595 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5544741c-88fd-4a7f-9321-927fcce85315 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:02.667059 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5544741c-88fd-4a7f-9321-927fcce85315 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:02.667833 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5544741c-88fd-4a7f-9321-927fcce85315 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:02.668270 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5544741c-88fd-4a7f-9321-927fcce85315 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:02.798449 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5544741c-88fd-4a7f-9321-927fcce85315 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:02.805821 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5544741c-88fd-4a7f-9321-927fcce85315 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428" status: 200 len: 1264 microversion: 2.1 time: 0.150271 Jul 07 10:30:02.806386 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 248/517] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:02 2022] GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:02.970037 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-c4e21d2e-0b1c-4fc0-ae3f-4eb27b534e2a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:02.970642 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-c4e21d2e-0b1c-4fc0-ae3f-4eb27b534e2a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:02.977134 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c4e21d2e-0b1c-4fc0-ae3f-4eb27b534e2a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:02.977584 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c4e21d2e-0b1c-4fc0-ae3f-4eb27b534e2a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:02.978346 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c4e21d2e-0b1c-4fc0-ae3f-4eb27b534e2a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:02.978779 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c4e21d2e-0b1c-4fc0-ae3f-4eb27b534e2a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:03.107012 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-c4e21d2e-0b1c-4fc0-ae3f-4eb27b534e2a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:03.115139 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-c4e21d2e-0b1c-4fc0-ae3f-4eb27b534e2a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1723 microversion: 2.1 time: 0.148989 Jul 07 10:30:03.115759 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 270/518] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:02 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:03.822534 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2aa4d2ad-85ea-4171-94c0-62b11ecdbba9 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:03.823150 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-2aa4d2ad-85ea-4171-94c0-62b11ecdbba9 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:03.829710 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2aa4d2ad-85ea-4171-94c0-62b11ecdbba9 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:03.830182 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2aa4d2ad-85ea-4171-94c0-62b11ecdbba9 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:03.830944 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2aa4d2ad-85ea-4171-94c0-62b11ecdbba9 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:03.831387 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2aa4d2ad-85ea-4171-94c0-62b11ecdbba9 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:03.962851 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-2aa4d2ad-85ea-4171-94c0-62b11ecdbba9 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:03.970838 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-2aa4d2ad-85ea-4171-94c0-62b11ecdbba9 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428" status: 200 len: 1264 microversion: 2.1 time: 0.152404 Jul 07 10:30:03.971401 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 249/519] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:03 2022] GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:04.132685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-9c2a09a8-8a80-4509-a1c6-6121acbf902e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:04.133232 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-9c2a09a8-8a80-4509-a1c6-6121acbf902e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:04.140185 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9c2a09a8-8a80-4509-a1c6-6121acbf902e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:04.140641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9c2a09a8-8a80-4509-a1c6-6121acbf902e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:04.141409 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9c2a09a8-8a80-4509-a1c6-6121acbf902e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:04.141850 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9c2a09a8-8a80-4509-a1c6-6121acbf902e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:04.268567 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-9c2a09a8-8a80-4509-a1c6-6121acbf902e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:04.276344 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-9c2a09a8-8a80-4509-a1c6-6121acbf902e tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1723 microversion: 2.1 time: 0.148240 Jul 07 10:30:04.276910 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 271/520] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:04 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:04.987101 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5a7076ab-ed76-4d44-b906-a871ebfe8093 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:04.987759 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5a7076ab-ed76-4d44-b906-a871ebfe8093 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:04.994272 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5a7076ab-ed76-4d44-b906-a871ebfe8093 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:04.994724 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5a7076ab-ed76-4d44-b906-a871ebfe8093 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:04.995482 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5a7076ab-ed76-4d44-b906-a871ebfe8093 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:04.995961 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5a7076ab-ed76-4d44-b906-a871ebfe8093 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:05.121586 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5a7076ab-ed76-4d44-b906-a871ebfe8093 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:05.128948 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5a7076ab-ed76-4d44-b906-a871ebfe8093 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428" status: 200 len: 1264 microversion: 2.1 time: 0.145693 Jul 07 10:30:05.129514 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 250/521] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:04 2022] GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 => generated 1264 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:05.293232 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-e153c288-3cb7-418f-874b-b7da8a149fea tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:05.293774 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-e153c288-3cb7-418f-874b-b7da8a149fea tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:05.300193 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e153c288-3cb7-418f-874b-b7da8a149fea tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:05.300644 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e153c288-3cb7-418f-874b-b7da8a149fea tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:05.301425 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e153c288-3cb7-418f-874b-b7da8a149fea tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:05.301863 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e153c288-3cb7-418f-874b-b7da8a149fea tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:05.430570 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-e153c288-3cb7-418f-874b-b7da8a149fea tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:05.438419 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-e153c288-3cb7-418f-874b-b7da8a149fea tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1723 microversion: 2.1 time: 0.149091 Jul 07 10:30:05.439384 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 272/522] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:05 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:05.940410 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-c9230955-8d65-46af-aaf1-cfbe145e506c req-94c7fc8d-0b35-4fe0-a8eb-6b38a7885af3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2364e764-0c0a-493f-bc92-2f8701294428", "name": "network-vif-plugged", "status": "completed", "tag": "552f5d9a-f502-4184-a7a5-3082829225b5"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:30:05.948989 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-c9230955-8d65-46af-aaf1-cfbe145e506c req-94c7fc8d-0b35-4fe0-a8eb-6b38a7885af3 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:05.949436 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-c9230955-8d65-46af-aaf1-cfbe145e506c req-94c7fc8d-0b35-4fe0-a8eb-6b38a7885af3 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:05.960511 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-c9230955-8d65-46af-aaf1-cfbe145e506c req-94c7fc8d-0b35-4fe0-a8eb-6b38a7885af3 service nova] Creating event network-vif-plugged:552f5d9a-f502-4184-a7a5-3082829225b5 for instance 2364e764-0c0a-493f-bc92-2f8701294428 on hv-cinder-82282 Jul 07 10:30:05.966641 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-c9230955-8d65-46af-aaf1-cfbe145e506c req-94c7fc8d-0b35-4fe0-a8eb-6b38a7885af3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029369 Jul 07 10:30:05.967900 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 251/523] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:30:06.145154 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-223c4a63-eb40-434e-b760-d55cf3965d74 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:06.145762 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-223c4a63-eb40-434e-b760-d55cf3965d74 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:06.151715 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-223c4a63-eb40-434e-b760-d55cf3965d74 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:06.152195 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-223c4a63-eb40-434e-b760-d55cf3965d74 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:06.152956 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-223c4a63-eb40-434e-b760-d55cf3965d74 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:06.153395 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-223c4a63-eb40-434e-b760-d55cf3965d74 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:06.278138 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-223c4a63-eb40-434e-b760-d55cf3965d74 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:06.285500 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-223c4a63-eb40-434e-b760-d55cf3965d74 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428" status: 200 len: 1264 microversion: 2.1 time: 0.144300 Jul 07 10:30:06.286055 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 273/524] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:06 2022] GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 => generated 1264 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:06.457582 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d5312f54-6b2d-4cfe-8e4e-01cd2663b226 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:06.458269 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d5312f54-6b2d-4cfe-8e4e-01cd2663b226 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:06.464845 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d5312f54-6b2d-4cfe-8e4e-01cd2663b226 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:06.465295 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d5312f54-6b2d-4cfe-8e4e-01cd2663b226 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:06.466082 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d5312f54-6b2d-4cfe-8e4e-01cd2663b226 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:06.466520 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d5312f54-6b2d-4cfe-8e4e-01cd2663b226 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:06.595182 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d5312f54-6b2d-4cfe-8e4e-01cd2663b226 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:06.603682 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d5312f54-6b2d-4cfe-8e4e-01cd2663b226 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1723 microversion: 2.1 time: 0.150778 Jul 07 10:30:06.604267 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 252/525] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:06 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:30:07.302662 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-c503f5d7-f2ce-4361-a156-7463c748f96b tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:07.303230 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-c503f5d7-f2ce-4361-a156-7463c748f96b tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:07.310295 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c503f5d7-f2ce-4361-a156-7463c748f96b tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:07.310748 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c503f5d7-f2ce-4361-a156-7463c748f96b tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:07.311515 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c503f5d7-f2ce-4361-a156-7463c748f96b tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:07.311987 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c503f5d7-f2ce-4361-a156-7463c748f96b tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:07.462133 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-c503f5d7-f2ce-4361-a156-7463c748f96b tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:07.469523 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-c503f5d7-f2ce-4361-a156-7463c748f96b tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428" status: 200 len: 1264 microversion: 2.1 time: 0.170931 Jul 07 10:30:07.470085 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 274/526] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:07 2022] GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:07.620966 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0dbf5760-0827-4c8b-986e-a129928de792 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:07.621578 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0dbf5760-0827-4c8b-986e-a129928de792 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:07.628053 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0dbf5760-0827-4c8b-986e-a129928de792 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:07.628507 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0dbf5760-0827-4c8b-986e-a129928de792 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:07.629261 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0dbf5760-0827-4c8b-986e-a129928de792 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:07.629696 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0dbf5760-0827-4c8b-986e-a129928de792 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:07.754988 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0dbf5760-0827-4c8b-986e-a129928de792 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:07.762869 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0dbf5760-0827-4c8b-986e-a129928de792 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1723 microversion: 2.1 time: 0.146275 Jul 07 10:30:07.763420 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 253/527] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:07 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:08.486421 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-34457898-3e80-4c21-94c2-685c9a2ac9b9 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:08.487050 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-34457898-3e80-4c21-94c2-685c9a2ac9b9 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:08.494092 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-34457898-3e80-4c21-94c2-685c9a2ac9b9 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:08.494539 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-34457898-3e80-4c21-94c2-685c9a2ac9b9 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:08.495410 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-34457898-3e80-4c21-94c2-685c9a2ac9b9 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:08.496924 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-34457898-3e80-4c21-94c2-685c9a2ac9b9 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:08.630927 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-34457898-3e80-4c21-94c2-685c9a2ac9b9 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:08.639938 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-34457898-3e80-4c21-94c2-685c9a2ac9b9 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428" status: 200 len: 1264 microversion: 2.1 time: 0.157314 Jul 07 10:30:08.640515 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 275/528] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:08 2022] GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:08.780644 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0ccbf919-d889-40db-a647-d554b7f7be23 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:08.781161 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0ccbf919-d889-40db-a647-d554b7f7be23 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:08.787682 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0ccbf919-d889-40db-a647-d554b7f7be23 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:08.788167 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0ccbf919-d889-40db-a647-d554b7f7be23 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:08.789579 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0ccbf919-d889-40db-a647-d554b7f7be23 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:08.790026 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0ccbf919-d889-40db-a647-d554b7f7be23 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:08.944448 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0ccbf919-d889-40db-a647-d554b7f7be23 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:08.953447 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0ccbf919-d889-40db-a647-d554b7f7be23 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1729 microversion: 2.1 time: 0.176875 Jul 07 10:30:08.954244 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 254/529] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:08 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:08.970412 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-f287c80b-b1f5-4002-9e1d-2d4cd6e48a80 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:08.970906 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-f287c80b-b1f5-4002-9e1d-2d4cd6e48a80 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:08.977521 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f287c80b-b1f5-4002-9e1d-2d4cd6e48a80 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:08.977978 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f287c80b-b1f5-4002-9e1d-2d4cd6e48a80 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:08.978741 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f287c80b-b1f5-4002-9e1d-2d4cd6e48a80 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:08.979176 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f287c80b-b1f5-4002-9e1d-2d4cd6e48a80 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:09.062220 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-f287c80b-b1f5-4002-9e1d-2d4cd6e48a80 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095519 Jul 07 10:30:09.062811 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 276/530] 10.222.0.16 () {58 vars in 1274 bytes} [Thu Jul 7 10:30:08 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:30:09.657152 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b70e0f93-1178-4d47-aa0e-e58e3ce203de tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:09.657766 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b70e0f93-1178-4d47-aa0e-e58e3ce203de tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:09.663688 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b70e0f93-1178-4d47-aa0e-e58e3ce203de tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:09.664687 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b70e0f93-1178-4d47-aa0e-e58e3ce203de tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:09.665442 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b70e0f93-1178-4d47-aa0e-e58e3ce203de tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:09.665872 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b70e0f93-1178-4d47-aa0e-e58e3ce203de tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:09.795371 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b70e0f93-1178-4d47-aa0e-e58e3ce203de tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:09.802929 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b70e0f93-1178-4d47-aa0e-e58e3ce203de tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428" status: 200 len: 1264 microversion: 2.1 time: 0.149583 Jul 07 10:30:09.803538 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 255/531] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:09 2022] GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:09.928440 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-3d37fc8d-459a-4e90-b001-ba7fb921cce0 req-ac78fb13-f18d-4646-930f-36e5b657364f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5080ca5c-bf77-4305-877b-c992e9248b40", "tag": "f2d0b2c3-ea20-4eea-87fe-434f9d0de45e"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:30:09.939056 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-3d37fc8d-459a-4e90-b001-ba7fb921cce0 req-ac78fb13-f18d-4646-930f-36e5b657364f service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:09.939873 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-3d37fc8d-459a-4e90-b001-ba7fb921cce0 req-ac78fb13-f18d-4646-930f-36e5b657364f service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:09.954960 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-3d37fc8d-459a-4e90-b001-ba7fb921cce0 req-ac78fb13-f18d-4646-930f-36e5b657364f service nova] Creating event network-changed:f2d0b2c3-ea20-4eea-87fe-434f9d0de45e for instance 5080ca5c-bf77-4305-877b-c992e9248b40 on hv-cinder-82282 Jul 07 10:30:09.961628 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-3d37fc8d-459a-4e90-b001-ba7fb921cce0 req-ac78fb13-f18d-4646-930f-36e5b657364f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036706 Jul 07 10:30:09.962621 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 277/532] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:30:10.003350 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4474c9e1-2b49-4cc5-8194-dc83da4320f6 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:10.003882 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-4474c9e1-2b49-4cc5-8194-dc83da4320f6 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: 169d7e71-dbcf-49c1-9f22-2e2fe854e9ab] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:10.010058 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4474c9e1-2b49-4cc5-8194-dc83da4320f6 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:10.010528 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4474c9e1-2b49-4cc5-8194-dc83da4320f6 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:10.011298 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4474c9e1-2b49-4cc5-8194-dc83da4320f6 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:10.011763 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4474c9e1-2b49-4cc5-8194-dc83da4320f6 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:10.104041 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.objects.instance [None req-4474c9e1-2b49-4cc5-8194-dc83da4320f6 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lazy-loading 'services' on Instance uuid 169d7e71-dbcf-49c1-9f22-2e2fe854e9ab {{(pid=117647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 10:30:10.225729 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-4474c9e1-2b49-4cc5-8194-dc83da4320f6 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "DELETE /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab/os-volume_attachments/53fbaa9d-f5f5-42a5-8439-97913e0734f8" status: 202 len: 0 microversion: 2.1 time: 0.226261 Jul 07 10:30:10.226891 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 256/533] 10.222.0.16 () {58 vars in 1415 bytes} [Thu Jul 7 10:30:09 2022] DELETE /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab/os-volume_attachments/53fbaa9d-f5f5-42a5-8439-97913e0734f8 => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 10:30:10.824736 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-0346e159-09e0-4d29-86b6-fa6cfbe59bd2 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:10.825810 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-0346e159-09e0-4d29-86b6-fa6cfbe59bd2 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:10.832710 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0346e159-09e0-4d29-86b6-fa6cfbe59bd2 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:10.833167 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0346e159-09e0-4d29-86b6-fa6cfbe59bd2 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:10.834094 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0346e159-09e0-4d29-86b6-fa6cfbe59bd2 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:10.834675 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0346e159-09e0-4d29-86b6-fa6cfbe59bd2 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:10.971613 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-0346e159-09e0-4d29-86b6-fa6cfbe59bd2 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:10.981941 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-0346e159-09e0-4d29-86b6-fa6cfbe59bd2 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428" status: 200 len: 1451 microversion: 2.1 time: 0.162628 Jul 07 10:30:10.984182 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 278/534] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:10 2022] GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 => generated 1451 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:10.998566 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-cab3fd8e-6c29-4459-bb85-a25f449f800e tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:10.999277 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-cab3fd8e-6c29-4459-bb85-a25f449f800e tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:11.006265 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cab3fd8e-6c29-4459-bb85-a25f449f800e tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:11.006726 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cab3fd8e-6c29-4459-bb85-a25f449f800e tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:11.008129 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cab3fd8e-6c29-4459-bb85-a25f449f800e tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:11.008784 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cab3fd8e-6c29-4459-bb85-a25f449f800e tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:11.167291 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-cab3fd8e-6c29-4459-bb85-a25f449f800e tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:11.174737 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-cab3fd8e-6c29-4459-bb85-a25f449f800e tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428" status: 200 len: 1451 microversion: 2.1 time: 0.181210 Jul 07 10:30:11.175298 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 257/535] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:10 2022] GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 => generated 1451 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:11.352237 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a651ae08-e9c9-4708-b590-837a7f9c0f9d tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:11.352735 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-a651ae08-e9c9-4708-b590-837a7f9c0f9d tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: 169d7e71-dbcf-49c1-9f22-2e2fe854e9ab] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:11.360019 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a651ae08-e9c9-4708-b590-837a7f9c0f9d tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:11.360699 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a651ae08-e9c9-4708-b590-837a7f9c0f9d tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:11.361510 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a651ae08-e9c9-4708-b590-837a7f9c0f9d tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:11.361952 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a651ae08-e9c9-4708-b590-837a7f9c0f9d tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:11.387521 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-a651ae08-e9c9-4708-b590-837a7f9c0f9d tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: 169d7e71-dbcf-49c1-9f22-2e2fe854e9ab] Going to try to terminate instance {{(pid=117646) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 10:30:11.463665 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-a651ae08-e9c9-4708-b590-837a7f9c0f9d tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "DELETE /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab" status: 204 len: 0 microversion: 2.1 time: 0.115627 Jul 07 10:30:11.465119 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 279/536] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jul 7 10:30:11 2022] DELETE /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 10:30:11.473558 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-549a2f7f-704e-4925-83ec-b462d806b93d tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:11.474105 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-549a2f7f-704e-4925-83ec-b462d806b93d tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: 169d7e71-dbcf-49c1-9f22-2e2fe854e9ab] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:11.481052 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-549a2f7f-704e-4925-83ec-b462d806b93d tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:11.481506 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-549a2f7f-704e-4925-83ec-b462d806b93d tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:11.482276 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-549a2f7f-704e-4925-83ec-b462d806b93d tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:11.482731 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-549a2f7f-704e-4925-83ec-b462d806b93d tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:11.689808 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-549a2f7f-704e-4925-83ec-b462d806b93d tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:11.697965 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-549a2f7f-704e-4925-83ec-b462d806b93d tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab" status: 200 len: 1511 microversion: 2.1 time: 0.228331 Jul 07 10:30:11.698531 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 258/537] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:11 2022] GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab => generated 1511 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:11.977837 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-f0069871-1d54-4a84-a97b-5b6fa8f466ca req-0d893f5b-4353-49fd-9766-c9b4dbf48fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5080ca5c-bf77-4305-877b-c992e9248b40", "tag": "f2d0b2c3-ea20-4eea-87fe-434f9d0de45e"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:30:11.986463 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-f0069871-1d54-4a84-a97b-5b6fa8f466ca req-0d893f5b-4353-49fd-9766-c9b4dbf48fd9 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:11.986906 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-f0069871-1d54-4a84-a97b-5b6fa8f466ca req-0d893f5b-4353-49fd-9766-c9b4dbf48fd9 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:11.999717 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-f0069871-1d54-4a84-a97b-5b6fa8f466ca req-0d893f5b-4353-49fd-9766-c9b4dbf48fd9 service nova] Creating event network-changed:f2d0b2c3-ea20-4eea-87fe-434f9d0de45e for instance 5080ca5c-bf77-4305-877b-c992e9248b40 on hv-cinder-82282 Jul 07 10:30:12.004822 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-f0069871-1d54-4a84-a97b-5b6fa8f466ca req-0d893f5b-4353-49fd-9766-c9b4dbf48fd9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031129 Jul 07 10:30:12.005411 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 280/538] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:30:12.716108 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c4e2fa88-c82b-4d2f-afc0-d49a50d08947 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:12.716667 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c4e2fa88-c82b-4d2f-afc0-d49a50d08947 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: 169d7e71-dbcf-49c1-9f22-2e2fe854e9ab] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:12.723074 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c4e2fa88-c82b-4d2f-afc0-d49a50d08947 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:12.723526 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c4e2fa88-c82b-4d2f-afc0-d49a50d08947 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:12.724333 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c4e2fa88-c82b-4d2f-afc0-d49a50d08947 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:12.724799 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c4e2fa88-c82b-4d2f-afc0-d49a50d08947 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:12.923383 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c4e2fa88-c82b-4d2f-afc0-d49a50d08947 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:12.931390 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c4e2fa88-c82b-4d2f-afc0-d49a50d08947 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab" status: 200 len: 1511 microversion: 2.1 time: 0.219267 Jul 07 10:30:12.932186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 259/539] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:12 2022] GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab => generated 1511 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:12.966685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-058c5412-705b-43fc-bd7d-cbcafa74be25 req-cd03faff-7248-45e8-911e-0aa6e5681011 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2364e764-0c0a-493f-bc92-2f8701294428", "tag": "552f5d9a-f502-4184-a7a5-3082829225b5"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:30:12.974709 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-058c5412-705b-43fc-bd7d-cbcafa74be25 req-cd03faff-7248-45e8-911e-0aa6e5681011 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:12.975158 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-058c5412-705b-43fc-bd7d-cbcafa74be25 req-cd03faff-7248-45e8-911e-0aa6e5681011 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:12.986094 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-058c5412-705b-43fc-bd7d-cbcafa74be25 req-cd03faff-7248-45e8-911e-0aa6e5681011 service nova] Creating event network-changed:552f5d9a-f502-4184-a7a5-3082829225b5 for instance 2364e764-0c0a-493f-bc92-2f8701294428 on hv-cinder-82282 Jul 07 10:30:12.990870 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-058c5412-705b-43fc-bd7d-cbcafa74be25 req-cd03faff-7248-45e8-911e-0aa6e5681011 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028192 Jul 07 10:30:12.991449 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 281/540] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:30:13.957605 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-3a72a858-c9f3-40c9-9867-32fac521ec7f tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:13.962482 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-3a72a858-c9f3-40c9-9867-32fac521ec7f tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: 169d7e71-dbcf-49c1-9f22-2e2fe854e9ab] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:13.983244 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3a72a858-c9f3-40c9-9867-32fac521ec7f tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:13.984065 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3a72a858-c9f3-40c9-9867-32fac521ec7f tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:13.986543 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3a72a858-c9f3-40c9-9867-32fac521ec7f tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:13.992498 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3a72a858-c9f3-40c9-9867-32fac521ec7f tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:14.423353 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-3a72a858-c9f3-40c9-9867-32fac521ec7f tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9476865e0b114996b2c0ffce9fca16a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd64979a2bc4ca6be57262f4387920e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:14.431345 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-3a72a858-c9f3-40c9-9867-32fac521ec7f tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab" status: 200 len: 1511 microversion: 2.1 time: 0.486518 Jul 07 10:30:14.432272 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 260/541] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:13 2022] GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab => generated 1511 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:15.013579 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-2084cc31-b949-410f-9ec6-3ea2e2d73155 req-c389f438-584e-44d5-99e4-cca456d25336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "169d7e71-dbcf-49c1-9f22-2e2fe854e9ab", "name": "network-vif-deleted", "tag": "6374acf9-967e-4103-9fea-a3e673c8bd19"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:30:15.022293 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-2084cc31-b949-410f-9ec6-3ea2e2d73155 req-c389f438-584e-44d5-99e4-cca456d25336 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:15.022949 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-2084cc31-b949-410f-9ec6-3ea2e2d73155 req-c389f438-584e-44d5-99e4-cca456d25336 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:15.035665 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-2084cc31-b949-410f-9ec6-3ea2e2d73155 req-c389f438-584e-44d5-99e4-cca456d25336 service nova] Creating event network-vif-deleted:6374acf9-967e-4103-9fea-a3e673c8bd19 for instance 169d7e71-dbcf-49c1-9f22-2e2fe854e9ab on hv-cinder-82282 Jul 07 10:30:15.043327 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-2084cc31-b949-410f-9ec6-3ea2e2d73155 req-c389f438-584e-44d5-99e4-cca456d25336 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041018 Jul 07 10:30:15.046936 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 282/542] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:30:15.449101 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b3a9c519-7e6a-4544-ad63-74d1b990f1c6 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:15.449714 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b3a9c519-7e6a-4544-ad63-74d1b990f1c6 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] [instance: 169d7e71-dbcf-49c1-9f22-2e2fe854e9ab] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:15.456323 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b3a9c519-7e6a-4544-ad63-74d1b990f1c6 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:15.456770 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b3a9c519-7e6a-4544-ad63-74d1b990f1c6 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:15.457523 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b3a9c519-7e6a-4544-ad63-74d1b990f1c6 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:15.457960 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b3a9c519-7e6a-4544-ad63-74d1b990f1c6 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:15.471382 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-b3a9c519-7e6a-4544-ad63-74d1b990f1c6 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] HTTP exception thrown: Instance 169d7e71-dbcf-49c1-9f22-2e2fe854e9ab could not be found. Jul 07 10:30:15.473012 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b3a9c519-7e6a-4544-ad63-74d1b990f1c6 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Request method failure captured: Jul 07 10:30:15.473012 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab HTTP/1.1 Jul 07 10:30:15.473012 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept: application/json Jul 07 10:30:15.473012 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jul 07 10:30:15.473012 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Connection: close Jul 07 10:30:15.473012 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jul 07 10:30:15.473012 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jul 07 10:30:15.473012 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Host: 10.222.0.16 Jul 07 10:30:15.473012 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jul 07 10:30:15.473012 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jul 07 10:30:15.473012 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABixrUm_Oy3yGlX9SF_tMz1LYh8yqBOuEVVCyU4tEdZ0HGRLrnfpTlQ6YPnYzfiljzDTHiq7kfB-rwSYpSFho72AceNM4k1sssflWU6B4HSAKhtBZQzFuG3XJuUXEGDwIcoCOzos71Qs7007lTP1P299BMu0WVNfAh4D-RO1N5XTy1quYE Jul 07 10:30:15.473012 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jul 07 10:30:15.473012 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jul 07 10:30:15.473012 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jul 07 10:30:15.473012 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jul 07 10:30:15.473012 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jul 07 10:30:15.473012 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jul 07 10:30:15.473012 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Id: 1bd64979a2bc4ca6be57262f4387920e Jul 07 10:30:15.473012 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-VolumesSnapshotTestJSON-712313930 Jul 07 10:30:15.473012 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jul 07 10:30:15.473012 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jul 07 10:30:15.474401 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1bd64979a2bc4ca6be57262f4387920e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1bd64979a2bc4ca6be57262f4387920e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1bd64979a2bc4ca6be57262f4387920e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1bd64979a2bc4ca6be57262f4387920e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:30:15.474401 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-VolumesSnapshotTestJSON-712313930 Jul 07 10:30:15.474401 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 1bd64979a2bc4ca6be57262f4387920e Jul 07 10:30:15.474401 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-712313930 Jul 07 10:30:15.474401 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User: tempest-VolumesSnapshotTestJSON-712313930-project Jul 07 10:30:15.474401 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jul 07 10:30:15.474401 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jul 07 10:30:15.474401 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Id: 9476865e0b114996b2c0ffce9fca16a2 Jul 07 10:30:15.474401 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-VolumesSnapshotTestJSON-712313930-project Jul 07 10:30:15.474401 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: method: > Jul 07 10:30:15.474401 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: exception: Instance 169d7e71-dbcf-49c1-9f22-2e2fe854e9ab could not be found. Jul 07 10:30:15.474401 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: action_args: {'id': '169d7e71-dbcf-49c1-9f22-2e2fe854e9ab'} Jul 07 10:30:15.475134 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:30:15.475134 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:30:15.475134 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:30:15.475134 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:30:15.475134 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:30:15.475134 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:30:15.475134 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:30:15.475134 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:30:15.475134 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:30:15.475134 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:30:15.475134 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 169d7e71-dbcf-49c1-9f22-2e2fe854e9ab could not be found. Jul 07 10:30:15.475134 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:30:15.475134 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:30:15.475134 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:30:15.475134 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:30:15.475134 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:30:15.475134 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:30:15.475134 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:30:15.475134 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:30:15.475134 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:30:15.477210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:30:15.477210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:30:15.477210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:30:15.477210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:30:15.477210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:30:15.477210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:30:15.477210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:30:15.477210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 169d7e71-dbcf-49c1-9f22-2e2fe854e9ab could not be found. Jul 07 10:30:15.477210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:30:15.477210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:30:15.477210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:30:15.477210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:30:15.477210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:30:15.477210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:30:15.477210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:30:15.477210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:30:15.477210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 169d7e71-dbcf-49c1-9f22-2e2fe854e9ab could not be found. Jul 07 10:30:15.477210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:30:15.478467 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b3a9c519-7e6a-4544-ad63-74d1b990f1c6 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] Returning 404 to user: Instance 169d7e71-dbcf-49c1-9f22-2e2fe854e9ab could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:30:15.478467 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b3a9c519-7e6a-4544-ad63-74d1b990f1c6 tempest-VolumesSnapshotTestJSON-712313930 tempest-VolumesSnapshotTestJSON-712313930-project] 10.222.0.16 "GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab" status: 404 len: 111 microversion: 2.1 time: 0.029237 Jul 07 10:30:15.478467 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 261/543] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:15 2022] GET /compute/v2.1/servers/169d7e71-dbcf-49c1-9f22-2e2fe854e9ab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:30:20.051937 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-6d34babf-1918-4827-a21d-eab1bdc1191c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1712880761"}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:30:20.052552 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-6d34babf-1918-4827-a21d-eab1bdc1191c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:20.059548 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6d34babf-1918-4827-a21d-eab1bdc1191c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:20.060024 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6d34babf-1918-4827-a21d-eab1bdc1191c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:20.060812 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6d34babf-1918-4827-a21d-eab1bdc1191c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:20.061244 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6d34babf-1918-4827-a21d-eab1bdc1191c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:20.186228 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.network.security_group_api [None req-6d34babf-1918-4827-a21d-eab1bdc1191c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Removing security group ab825954-2df2-4bb0-978d-9769ce31159f from port 9e1716e6-ca2c-42e2-be39-5e2596494efc Jul 07 10:30:20.533189 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-6d34babf-1918-4827-a21d-eab1bdc1191c tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "POST /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02/action" status: 202 len: 0 microversion: 2.1 time: 0.485440 Jul 07 10:30:20.533804 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 283/544] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Jul 7 10:30:20 2022] POST /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 10:30:20.548786 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-a864e5de-8d95-4983-9a4a-33babf9bc0be req-0b930c8f-fe42-427d-8e3e-a5bac9b60f5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca65cd17-61ba-4122-ba4b-59953053de02", "tag": "9e1716e6-ca2c-42e2-be39-5e2596494efc"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:30:20.568295 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-a864e5de-8d95-4983-9a4a-33babf9bc0be req-0b930c8f-fe42-427d-8e3e-a5bac9b60f5c service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:20.569834 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-a864e5de-8d95-4983-9a4a-33babf9bc0be req-0b930c8f-fe42-427d-8e3e-a5bac9b60f5c service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:20.588717 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-a864e5de-8d95-4983-9a4a-33babf9bc0be req-0b930c8f-fe42-427d-8e3e-a5bac9b60f5c service nova] Creating event network-changed:9e1716e6-ca2c-42e2-be39-5e2596494efc for instance ca65cd17-61ba-4122-ba4b-59953053de02 on hv-cinder-82282 Jul 07 10:30:20.593808 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-a864e5de-8d95-4983-9a4a-33babf9bc0be req-0b930c8f-fe42-427d-8e3e-a5bac9b60f5c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048642 Jul 07 10:30:20.594994 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 262/545] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:30:21.986640 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-428e52bc-1dd0-49a9-ad75-1b2b1f1c1948 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:21.987138 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-428e52bc-1dd0-49a9-ad75-1b2b1f1c1948 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:21.994094 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-428e52bc-1dd0-49a9-ad75-1b2b1f1c1948 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:21.994545 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-428e52bc-1dd0-49a9-ad75-1b2b1f1c1948 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:21.995300 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-428e52bc-1dd0-49a9-ad75-1b2b1f1c1948 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:21.995734 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-428e52bc-1dd0-49a9-ad75-1b2b1f1c1948 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:22.015019 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:30:22.082315 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.objects.instance [None req-428e52bc-1dd0-49a9-ad75-1b2b1f1c1948 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lazy-loading 'services' on Instance uuid ca65cd17-61ba-4122-ba4b-59953053de02 {{(pid=117646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 10:30:22.163567 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-428e52bc-1dd0-49a9-ad75-1b2b1f1c1948 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02/os-volume_attachments/62ef1a09-5890-4886-9619-410794272f77" status: 202 len: 0 microversion: 2.1 time: 0.180993 Jul 07 10:30:22.164084 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 284/546] 10.222.0.16 () {58 vars in 1415 bytes} [Thu Jul 7 10:30:21 2022] DELETE /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02/os-volume_attachments/62ef1a09-5890-4886-9619-410794272f77 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 10:30:22.173553 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2a226b9b-09d3-4fbd-8264-b7f672df3c3e tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:22.174641 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-2a226b9b-09d3-4fbd-8264-b7f672df3c3e tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:22.181473 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2a226b9b-09d3-4fbd-8264-b7f672df3c3e tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:22.182132 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2a226b9b-09d3-4fbd-8264-b7f672df3c3e tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:22.183042 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2a226b9b-09d3-4fbd-8264-b7f672df3c3e tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:22.183336 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2a226b9b-09d3-4fbd-8264-b7f672df3c3e tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:22.215733 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-2a226b9b-09d3-4fbd-8264-b7f672df3c3e tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046938 Jul 07 10:30:22.216629 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 263/547] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jul 7 10:30:22 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:30:22.610195 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-ee893aff-3f75-49f0-bbcd-35a4c649eae7 req-85f7602c-e65c-4516-b2f0-1f0d1b5415a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca65cd17-61ba-4122-ba4b-59953053de02", "tag": "9e1716e6-ca2c-42e2-be39-5e2596494efc"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:30:22.619575 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-ee893aff-3f75-49f0-bbcd-35a4c649eae7 req-85f7602c-e65c-4516-b2f0-1f0d1b5415a8 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:22.620058 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-ee893aff-3f75-49f0-bbcd-35a4c649eae7 req-85f7602c-e65c-4516-b2f0-1f0d1b5415a8 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:22.631989 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-ee893aff-3f75-49f0-bbcd-35a4c649eae7 req-85f7602c-e65c-4516-b2f0-1f0d1b5415a8 service nova] Creating event network-changed:9e1716e6-ca2c-42e2-be39-5e2596494efc for instance ca65cd17-61ba-4122-ba4b-59953053de02 on hv-cinder-82282 Jul 07 10:30:22.636918 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-ee893aff-3f75-49f0-bbcd-35a4c649eae7 req-85f7602c-e65c-4516-b2f0-1f0d1b5415a8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031005 Jul 07 10:30:22.637750 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 285/548] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:30:23.227653 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9e209ca6-ab25-497a-87b4-4a4853e190d6 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:23.228628 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-9e209ca6-ab25-497a-87b4-4a4853e190d6 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:23.234944 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9e209ca6-ab25-497a-87b4-4a4853e190d6 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:23.235391 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9e209ca6-ab25-497a-87b4-4a4853e190d6 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:23.236172 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9e209ca6-ab25-497a-87b4-4a4853e190d6 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:23.236619 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9e209ca6-ab25-497a-87b4-4a4853e190d6 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:23.264285 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9e209ca6-ab25-497a-87b4-4a4853e190d6 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040601 Jul 07 10:30:23.264838 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 264/549] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jul 7 10:30:23 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 10:30:23.276389 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-12d07f3a-5d27-4f3a-b03a-9558ee0a342f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:23.276899 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-12d07f3a-5d27-4f3a-b03a-9558ee0a342f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:23.282947 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-12d07f3a-5d27-4f3a-b03a-9558ee0a342f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:23.283393 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-12d07f3a-5d27-4f3a-b03a-9558ee0a342f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:23.284173 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-12d07f3a-5d27-4f3a-b03a-9558ee0a342f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:23.284605 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-12d07f3a-5d27-4f3a-b03a-9558ee0a342f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:23.357998 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.wsgi [None req-12d07f3a-5d27-4f3a-b03a-9558ee0a342f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] HTTP exception thrown: Instance ca65cd17-61ba-4122-ba4b-59953053de02 is not attached to volume 62ef1a09-5890-4886-9619-410794272f77 Jul 07 10:30:23.360438 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-12d07f3a-5d27-4f3a-b03a-9558ee0a342f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Request method failure captured: Jul 07 10:30:23.360438 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: DELETE /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02/os-volume_attachments/62ef1a09-5890-4886-9619-410794272f77 HTTP/1.1 Jul 07 10:30:23.360438 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:30:23.360438 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:30:23.360438 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:30:23.360438 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 0 Jul 07 10:30:23.360438 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:30:23.360438 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:30:23.360438 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:30:23.360438 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:30:23.360438 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrT-2lT9xR4vPNiy-Zj_eIf8dmxe0RPotfWhv-NIv0_Jeoio2toE5nB113pMZYI2lqwOtStoJm0gANgzSjoVwLiCZpJdAHMY1m0OLyAyKO-sDvbYmaQAk8DcL5TjM3kHKvyexiOnZifxQT6RHn-ea7XMHMiTxdkesKqhV0FX10BiN1o Jul 07 10:30:23.360438 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:30:23.360438 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:30:23.360438 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:30:23.360438 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:30:23.360438 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:30:23.360438 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:30:23.360438 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: 5a2481546251413fb65aaed9e3f131e2 Jul 07 10:30:23.360438 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-TestMinimumBasicScenario-1830678696 Jul 07 10:30:23.360438 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:30:23.360438 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:30:23.361985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a2481546251413fb65aaed9e3f131e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a2481546251413fb65aaed9e3f131e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a2481546251413fb65aaed9e3f131e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a2481546251413fb65aaed9e3f131e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:30:23.361985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-TestMinimumBasicScenario-1830678696 Jul 07 10:30:23.361985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: 5a2481546251413fb65aaed9e3f131e2 Jul 07 10:30:23.361985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1830678696 Jul 07 10:30:23.361985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-TestMinimumBasicScenario-1830678696-project Jul 07 10:30:23.361985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:30:23.361985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:30:23.361985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: 9ae3a6ce6ab4425ebf1180721c10eb2d Jul 07 10:30:23.361985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-TestMinimumBasicScenario-1830678696-project Jul 07 10:30:23.361985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: > Jul 07 10:30:23.361985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Instance ca65cd17-61ba-4122-ba4b-59953053de02 is not attached to volume 62ef1a09-5890-4886-9619-410794272f77 Jul 07 10:30:23.363576 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'server_id': 'ca65cd17-61ba-4122-ba4b-59953053de02', 'id': '62ef1a09-5890-4886-9619-410794272f77'} Jul 07 10:30:23.363576 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:30:23.363576 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:30:23.363576 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 07 10:30:23.363576 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 07 10:30:23.363576 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 07 10:30:23.363576 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 07 10:30:23.363576 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 07 10:30:23.363576 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 07 10:30:23.363576 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 62ef1a09-5890-4886-9619-410794272f77. Jul 07 10:30:23.363576 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:30:23.363576 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:30:23.363576 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:30:23.363576 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:30:23.363576 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:30:23.363576 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:30:23.363576 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:30:23.363576 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:30:23.363576 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:30:23.364980 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:30:23.364980 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 07 10:30:23.364980 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 07 10:30:23.364980 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca65cd17-61ba-4122-ba4b-59953053de02 is not attached to volume 62ef1a09-5890-4886-9619-410794272f77 Jul 07 10:30:23.364980 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:30:23.364980 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:30:23.364980 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:30:23.364980 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:30:23.364980 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:30:23.364980 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:30:23.364980 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:30:23.364980 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:30:23.364980 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca65cd17-61ba-4122-ba4b-59953053de02 is not attached to volume 62ef1a09-5890-4886-9619-410794272f77 Jul 07 10:30:23.364980 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:30:23.364980 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-12d07f3a-5d27-4f3a-b03a-9558ee0a342f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Returning 404 to user: Instance ca65cd17-61ba-4122-ba4b-59953053de02 is not attached to volume 62ef1a09-5890-4886-9619-410794272f77 {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:30:23.366071 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-12d07f3a-5d27-4f3a-b03a-9558ee0a342f tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02/os-volume_attachments/62ef1a09-5890-4886-9619-410794272f77" status: 404 len: 154 microversion: 2.1 time: 0.091116 Jul 07 10:30:23.366071 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 286/550] 10.222.0.16 () {58 vars in 1415 bytes} [Thu Jul 7 10:30:23 2022] DELETE /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02/os-volume_attachments/62ef1a09-5890-4886-9619-410794272f77 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:30:24.496546 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0d1a1852-ca5b-4b8d-982c-97f34ac0dc6a tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:24.497046 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0d1a1852-ca5b-4b8d-982c-97f34ac0dc6a tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:24.503464 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0d1a1852-ca5b-4b8d-982c-97f34ac0dc6a tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:24.503963 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0d1a1852-ca5b-4b8d-982c-97f34ac0dc6a tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:24.504724 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0d1a1852-ca5b-4b8d-982c-97f34ac0dc6a tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:24.505202 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0d1a1852-ca5b-4b8d-982c-97f34ac0dc6a tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:24.530213 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0d1a1852-ca5b-4b8d-982c-97f34ac0dc6a tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Going to try to terminate instance {{(pid=117647) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 10:30:24.533012 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:30:24.603677 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0d1a1852-ca5b-4b8d-982c-97f34ac0dc6a tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 204 len: 0 microversion: 2.1 time: 0.110503 Jul 07 10:30:24.604286 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 265/551] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jul 7 10:30:24 2022] DELETE /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 10:30:24.612557 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-ccd1b156-dd1f-4976-b9b2-48af543a93a2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:24.613270 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-ccd1b156-dd1f-4976-b9b2-48af543a93a2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:24.620949 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ccd1b156-dd1f-4976-b9b2-48af543a93a2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:24.621401 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ccd1b156-dd1f-4976-b9b2-48af543a93a2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:24.622162 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ccd1b156-dd1f-4976-b9b2-48af543a93a2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:24.622596 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ccd1b156-dd1f-4976-b9b2-48af543a93a2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:24.748683 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-ccd1b156-dd1f-4976-b9b2-48af543a93a2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:24.756176 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-ccd1b156-dd1f-4976-b9b2-48af543a93a2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1554 microversion: 2.1 time: 0.147622 Jul 07 10:30:24.756728 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 287/552] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:24 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:25.773896 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d31d2a51-f0ca-4da6-86e2-ff75c9f0dfc9 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:25.774526 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d31d2a51-f0ca-4da6-86e2-ff75c9f0dfc9 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:25.780999 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d31d2a51-f0ca-4da6-86e2-ff75c9f0dfc9 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:25.781455 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d31d2a51-f0ca-4da6-86e2-ff75c9f0dfc9 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:25.782221 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d31d2a51-f0ca-4da6-86e2-ff75c9f0dfc9 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:25.782660 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d31d2a51-f0ca-4da6-86e2-ff75c9f0dfc9 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:25.915881 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d31d2a51-f0ca-4da6-86e2-ff75c9f0dfc9 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:25.923308 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d31d2a51-f0ca-4da6-86e2-ff75c9f0dfc9 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1554 microversion: 2.1 time: 0.153734 Jul 07 10:30:25.923903 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 266/553] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:25 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:26.940707 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-6d561268-03ae-4df0-a9eb-8e9b292732d2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:26.941312 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-6d561268-03ae-4df0-a9eb-8e9b292732d2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:26.943768 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:30:26.950417 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6d561268-03ae-4df0-a9eb-8e9b292732d2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:26.950863 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6d561268-03ae-4df0-a9eb-8e9b292732d2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:26.951615 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6d561268-03ae-4df0-a9eb-8e9b292732d2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:26.952077 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6d561268-03ae-4df0-a9eb-8e9b292732d2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:27.080500 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-6d561268-03ae-4df0-a9eb-8e9b292732d2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:27.088449 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-6d561268-03ae-4df0-a9eb-8e9b292732d2 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1554 microversion: 2.1 time: 0.151593 Jul 07 10:30:27.089002 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 288/554] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:26 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:28.105828 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9cde8fd9-5f6e-48dd-bb46-2d50a0e97f79 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:28.106467 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-9cde8fd9-5f6e-48dd-bb46-2d50a0e97f79 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:28.112982 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9cde8fd9-5f6e-48dd-bb46-2d50a0e97f79 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:28.113430 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9cde8fd9-5f6e-48dd-bb46-2d50a0e97f79 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:28.114187 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9cde8fd9-5f6e-48dd-bb46-2d50a0e97f79 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:28.114618 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9cde8fd9-5f6e-48dd-bb46-2d50a0e97f79 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:28.242999 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9cde8fd9-5f6e-48dd-bb46-2d50a0e97f79 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:28.250376 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9cde8fd9-5f6e-48dd-bb46-2d50a0e97f79 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1554 microversion: 2.1 time: 0.148379 Jul 07 10:30:28.250937 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 267/555] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:28 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:29.223121 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-4c88097b-73b5-4562-b606-28bf861ac234 req-32b6aa49-8486-4e72-9b4c-40254195685f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca65cd17-61ba-4122-ba4b-59953053de02", "name": "network-vif-deleted", "tag": "9e1716e6-ca2c-42e2-be39-5e2596494efc"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:30:29.232497 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-4c88097b-73b5-4562-b606-28bf861ac234 req-32b6aa49-8486-4e72-9b4c-40254195685f service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:29.233254 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-4c88097b-73b5-4562-b606-28bf861ac234 req-32b6aa49-8486-4e72-9b4c-40254195685f service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:29.253162 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-4c88097b-73b5-4562-b606-28bf861ac234 req-32b6aa49-8486-4e72-9b4c-40254195685f service nova] Creating event network-vif-deleted:9e1716e6-ca2c-42e2-be39-5e2596494efc for instance ca65cd17-61ba-4122-ba4b-59953053de02 on hv-cinder-82282 Jul 07 10:30:29.257991 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-4c88097b-73b5-4562-b606-28bf861ac234 req-32b6aa49-8486-4e72-9b4c-40254195685f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038824 Jul 07 10:30:29.258755 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 289/556] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:30:29.266604 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-eda9fe74-d41b-4534-be25-92f71a69cdaf tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:29.267221 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-eda9fe74-d41b-4534-be25-92f71a69cdaf tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:29.270772 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:30:29.275065 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-eda9fe74-d41b-4534-be25-92f71a69cdaf tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:29.275695 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-eda9fe74-d41b-4534-be25-92f71a69cdaf tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:29.276686 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-eda9fe74-d41b-4534-be25-92f71a69cdaf tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:29.277288 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-eda9fe74-d41b-4534-be25-92f71a69cdaf tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:29.354879 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-eda9fe74-d41b-4534-be25-92f71a69cdaf tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae3a6ce6ab4425ebf1180721c10eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2481546251413fb65aaed9e3f131e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:29.362768 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-eda9fe74-d41b-4534-be25-92f71a69cdaf tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 200 len: 1344 microversion: 2.1 time: 0.100103 Jul 07 10:30:29.363664 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 268/557] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:29 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 1344 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:30.381291 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-97cdc590-72b1-4495-b5f0-950300a0e620 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:30.381986 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-97cdc590-72b1-4495-b5f0-950300a0e620 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] [instance: ca65cd17-61ba-4122-ba4b-59953053de02] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:30.389763 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-97cdc590-72b1-4495-b5f0-950300a0e620 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:30.390216 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-97cdc590-72b1-4495-b5f0-950300a0e620 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:30.390998 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-97cdc590-72b1-4495-b5f0-950300a0e620 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:30.391432 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-97cdc590-72b1-4495-b5f0-950300a0e620 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:30.405010 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.wsgi [None req-97cdc590-72b1-4495-b5f0-950300a0e620 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] HTTP exception thrown: Instance ca65cd17-61ba-4122-ba4b-59953053de02 could not be found. Jul 07 10:30:30.406638 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-97cdc590-72b1-4495-b5f0-950300a0e620 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Request method failure captured: Jul 07 10:30:30.406638 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 HTTP/1.1 Jul 07 10:30:30.406638 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:30:30.406638 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:30:30.406638 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:30:30.406638 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 0 Jul 07 10:30:30.406638 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:30:30.406638 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:30:30.406638 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:30:30.406638 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:30:30.406638 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrT-2lT9xR4vPNiy-Zj_eIf8dmxe0RPotfWhv-NIv0_Jeoio2toE5nB113pMZYI2lqwOtStoJm0gANgzSjoVwLiCZpJdAHMY1m0OLyAyKO-sDvbYmaQAk8DcL5TjM3kHKvyexiOnZifxQT6RHn-ea7XMHMiTxdkesKqhV0FX10BiN1o Jul 07 10:30:30.406638 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:30:30.406638 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:30:30.406638 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:30:30.406638 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:30:30.406638 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:30:30.406638 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:30:30.406638 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: 5a2481546251413fb65aaed9e3f131e2 Jul 07 10:30:30.406638 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-TestMinimumBasicScenario-1830678696 Jul 07 10:30:30.406638 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:30:30.406638 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:30:30.408279 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a2481546251413fb65aaed9e3f131e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a2481546251413fb65aaed9e3f131e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a2481546251413fb65aaed9e3f131e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a2481546251413fb65aaed9e3f131e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:30:30.408279 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-TestMinimumBasicScenario-1830678696 Jul 07 10:30:30.408279 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: 5a2481546251413fb65aaed9e3f131e2 Jul 07 10:30:30.408279 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1830678696 Jul 07 10:30:30.408279 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-TestMinimumBasicScenario-1830678696-project Jul 07 10:30:30.408279 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:30:30.408279 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:30:30.408279 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: 9ae3a6ce6ab4425ebf1180721c10eb2d Jul 07 10:30:30.408279 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-TestMinimumBasicScenario-1830678696-project Jul 07 10:30:30.408279 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: > Jul 07 10:30:30.408279 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Instance ca65cd17-61ba-4122-ba4b-59953053de02 could not be found. Jul 07 10:30:30.408279 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'id': 'ca65cd17-61ba-4122-ba4b-59953053de02'} Jul 07 10:30:30.409379 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:30:30.409379 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:30:30.409379 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:30:30.409379 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:30:30.409379 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:30:30.409379 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:30:30.409379 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:30:30.409379 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:30:30.409379 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:30:30.409379 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:30:30.409379 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca65cd17-61ba-4122-ba4b-59953053de02 could not be found. Jul 07 10:30:30.409379 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:30:30.409379 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:30:30.409379 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:30:30.409379 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:30:30.409379 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:30:30.409379 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:30:30.409379 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:30:30.409379 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:30:30.409379 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:30:30.410613 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:30:30.410613 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:30:30.410613 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:30:30.410613 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:30:30.410613 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:30:30.410613 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:30:30.410613 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:30:30.410613 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca65cd17-61ba-4122-ba4b-59953053de02 could not be found. Jul 07 10:30:30.410613 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:30:30.410613 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:30:30.410613 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:30:30.410613 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:30:30.410613 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:30:30.410613 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:30:30.410613 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:30:30.410613 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:30:30.410613 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca65cd17-61ba-4122-ba4b-59953053de02 could not be found. Jul 07 10:30:30.410613 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:30:30.412023 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-97cdc590-72b1-4495-b5f0-950300a0e620 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Returning 404 to user: Instance ca65cd17-61ba-4122-ba4b-59953053de02 could not be found. {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:30:30.412023 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-97cdc590-72b1-4495-b5f0-950300a0e620 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02" status: 404 len: 111 microversion: 2.1 time: 0.031316 Jul 07 10:30:30.412023 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 290/558] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:30 2022] GET /compute/v2.1/servers/ca65cd17-61ba-4122-ba4b-59953053de02 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:30:30.416923 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-707a930a-67c6-450e-aac7-e11883df49f5 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] Calling method '.version_select at 0x7f9e9e51e4c0>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:30.438087 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-707a930a-67c6-450e-aac7-e11883df49f5 tempest-TestMinimumBasicScenario-1830678696 tempest-TestMinimumBasicScenario-1830678696-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1225089622" status: 202 len: 0 microversion: 2.1 time: 0.025107 Jul 07 10:30:30.442334 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 269/559] 10.222.0.16 () {58 vars in 1271 bytes} [Thu Jul 7 10:30:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1225089622 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 10:30:48.727554 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-71402196-fbfe-4ed9-8d84-0fc97404aeea tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:48.728534 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-71402196-fbfe-4ed9-8d84-0fc97404aeea tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:48.731364 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_api:SELECT=5 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:30:48.732040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:30:48.737525 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-71402196-fbfe-4ed9-8d84-0fc97404aeea tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:48.737976 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-71402196-fbfe-4ed9-8d84-0fc97404aeea tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:48.738734 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-71402196-fbfe-4ed9-8d84-0fc97404aeea tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:48.739172 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-71402196-fbfe-4ed9-8d84-0fc97404aeea tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:48.769130 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-71402196-fbfe-4ed9-8d84-0fc97404aeea tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045941 Jul 07 10:30:48.769642 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 291/560] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jul 7 10:30:48 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 10:30:48.823911 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:30:48.824651 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:30:48.829218 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-3ff37254-53a2-4427-8b07-757d70b990dd tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:48.829717 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-3ff37254-53a2-4427-8b07-757d70b990dd tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:48.837684 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3ff37254-53a2-4427-8b07-757d70b990dd tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:48.838229 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3ff37254-53a2-4427-8b07-757d70b990dd tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:48.838983 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3ff37254-53a2-4427-8b07-757d70b990dd tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:48.839412 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3ff37254-53a2-4427-8b07-757d70b990dd tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:48.865312 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-3ff37254-53a2-4427-8b07-757d70b990dd tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Going to try to terminate instance {{(pid=117647) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 10:30:48.938339 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-3ff37254-53a2-4427-8b07-757d70b990dd tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 204 len: 0 microversion: 2.1 time: 0.115838 Jul 07 10:30:48.939335 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 270/561] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jul 7 10:30:48 2022] DELETE /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 10:30:48.947629 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-0a704f1a-5788-4272-887e-fceb417d18fa tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:48.948271 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-0a704f1a-5788-4272-887e-fceb417d18fa tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:48.954201 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0a704f1a-5788-4272-887e-fceb417d18fa tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:48.954655 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0a704f1a-5788-4272-887e-fceb417d18fa tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:48.955415 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0a704f1a-5788-4272-887e-fceb417d18fa tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:48.955881 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0a704f1a-5788-4272-887e-fceb417d18fa tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:49.236273 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-0a704f1a-5788-4272-887e-fceb417d18fa tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:49.243794 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-0a704f1a-5788-4272-887e-fceb417d18fa tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1674 microversion: 2.1 time: 0.300323 Jul 07 10:30:49.244361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 292/562] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:48 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1674 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:50.261393 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-12b56d96-0394-4ca2-9116-8a8941fefde0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:50.262090 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-12b56d96-0394-4ca2-9116-8a8941fefde0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:50.268563 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-12b56d96-0394-4ca2-9116-8a8941fefde0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:50.269017 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-12b56d96-0394-4ca2-9116-8a8941fefde0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:50.269770 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-12b56d96-0394-4ca2-9116-8a8941fefde0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:50.270209 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-12b56d96-0394-4ca2-9116-8a8941fefde0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:50.453371 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-12b56d96-0394-4ca2-9116-8a8941fefde0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:50.461574 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-12b56d96-0394-4ca2-9116-8a8941fefde0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1674 microversion: 2.1 time: 0.204427 Jul 07 10:30:50.462141 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 271/563] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:50 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1674 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:51.477700 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-f3f3b00b-08b5-4f25-9975-6576d7eb9244 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:51.478331 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-f3f3b00b-08b5-4f25-9975-6576d7eb9244 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:51.484757 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f3f3b00b-08b5-4f25-9975-6576d7eb9244 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:51.485212 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f3f3b00b-08b5-4f25-9975-6576d7eb9244 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:51.485971 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f3f3b00b-08b5-4f25-9975-6576d7eb9244 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:51.486409 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f3f3b00b-08b5-4f25-9975-6576d7eb9244 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:51.617798 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-f3f3b00b-08b5-4f25-9975-6576d7eb9244 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:51.625210 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-f3f3b00b-08b5-4f25-9975-6576d7eb9244 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1674 microversion: 2.1 time: 0.151385 Jul 07 10:30:51.625773 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 293/564] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:51 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:52.642397 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0c7d3b91-852a-4837-90e4-86a5a219037b tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:52.643005 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0c7d3b91-852a-4837-90e4-86a5a219037b tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:52.650040 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0c7d3b91-852a-4837-90e4-86a5a219037b tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:52.650488 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0c7d3b91-852a-4837-90e4-86a5a219037b tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:52.651247 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0c7d3b91-852a-4837-90e4-86a5a219037b tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:52.651685 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0c7d3b91-852a-4837-90e4-86a5a219037b tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:52.780807 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0c7d3b91-852a-4837-90e4-86a5a219037b tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:52.788717 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0c7d3b91-852a-4837-90e4-86a5a219037b tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1674 microversion: 2.1 time: 0.149767 Jul 07 10:30:52.788885 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 272/565] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:52 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:53.805754 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-0b2829d5-8436-4166-bcd9-8ee5d9a1ab86 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:53.806362 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-0b2829d5-8436-4166-bcd9-8ee5d9a1ab86 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:53.812610 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0b2829d5-8436-4166-bcd9-8ee5d9a1ab86 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:53.813061 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0b2829d5-8436-4166-bcd9-8ee5d9a1ab86 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:53.813830 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0b2829d5-8436-4166-bcd9-8ee5d9a1ab86 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:53.814269 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0b2829d5-8436-4166-bcd9-8ee5d9a1ab86 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:53.955188 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-0b2829d5-8436-4166-bcd9-8ee5d9a1ab86 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:53.963836 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-0b2829d5-8436-4166-bcd9-8ee5d9a1ab86 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 200 len: 1674 microversion: 2.1 time: 0.161953 Jul 07 10:30:53.964420 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 294/566] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:53 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:54.441456 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-0d92de38-b316-4e51-b2e5-b7a602c3d5e9 req-d3de5845-145d-4d58-b891-15a268610e8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b00a3c72-669b-41e2-a9b9-1a2921bcabe0", "name": "network-vif-deleted", "tag": "ab69b298-c3d4-4702-89eb-78fe3392b9f5"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:30:54.450424 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-0d92de38-b316-4e51-b2e5-b7a602c3d5e9 req-d3de5845-145d-4d58-b891-15a268610e8a service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:54.451250 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-0d92de38-b316-4e51-b2e5-b7a602c3d5e9 req-d3de5845-145d-4d58-b891-15a268610e8a service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:54.463875 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-0d92de38-b316-4e51-b2e5-b7a602c3d5e9 req-d3de5845-145d-4d58-b891-15a268610e8a service nova] Creating event network-vif-deleted:ab69b298-c3d4-4702-89eb-78fe3392b9f5 for instance b00a3c72-669b-41e2-a9b9-1a2921bcabe0 on hv-cinder-82282 Jul 07 10:30:54.471698 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-0d92de38-b316-4e51-b2e5-b7a602c3d5e9 req-d3de5845-145d-4d58-b891-15a268610e8a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034645 Jul 07 10:30:54.472325 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 273/567] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:30:54.982475 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a92e6a9b-b478-44e6-b54c-cb8fec2c5671 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:54.984380 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-a92e6a9b-b478-44e6-b54c-cb8fec2c5671 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:54.993416 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a92e6a9b-b478-44e6-b54c-cb8fec2c5671 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:54.994787 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a92e6a9b-b478-44e6-b54c-cb8fec2c5671 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:54.995666 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a92e6a9b-b478-44e6-b54c-cb8fec2c5671 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:54.996291 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a92e6a9b-b478-44e6-b54c-cb8fec2c5671 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:55.011070 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.wsgi [None req-a92e6a9b-b478-44e6-b54c-cb8fec2c5671 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] HTTP exception thrown: Instance b00a3c72-669b-41e2-a9b9-1a2921bcabe0 could not be found. Jul 07 10:30:55.012640 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a92e6a9b-b478-44e6-b54c-cb8fec2c5671 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Request method failure captured: Jul 07 10:30:55.012640 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 HTTP/1.1 Jul 07 10:30:55.012640 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:30:55.012640 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:30:55.012640 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:30:55.012640 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 0 Jul 07 10:30:55.012640 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:30:55.012640 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:30:55.012640 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:30:55.012640 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:30:55.012640 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrS2CO6Q7wY8_KtEd72k98g5X8mz9ws6rDrkmXy7itq_fzajI2OiMopidCXdHexrLwHj7jg6YyAlzqalbXHstoqHcVpwLOjCfZern2P_WHykfXakXHVGQjV1s462g60dIKQh97Phl0wAVhWIP5HhcRfOcwMz0nAW9gYkMLF5mIE0Gxw Jul 07 10:30:55.012640 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:30:55.012640 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:30:55.012640 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:30:55.012640 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:30:55.012640 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:30:55.012640 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:30:55.012640 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: 98924fde961c41358ffb24ac3819557a Jul 07 10:30:55.012640 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-AttachVolumeTestJSON-11612011 Jul 07 10:30:55.012640 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:30:55.012640 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:30:55.014232 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98924fde961c41358ffb24ac3819557a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/98924fde961c41358ffb24ac3819557a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98924fde961c41358ffb24ac3819557a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_98924fde961c41358ffb24ac3819557a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:30:55.014232 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-AttachVolumeTestJSON-11612011 Jul 07 10:30:55.014232 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: 98924fde961c41358ffb24ac3819557a Jul 07 10:30:55.014232 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-AttachVolumeTestJSON-11612011 Jul 07 10:30:55.014232 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-AttachVolumeTestJSON-11612011-project Jul 07 10:30:55.014232 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:30:55.014232 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:30:55.014232 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: 247787cd745444f38953a64780d6ac9b Jul 07 10:30:55.014232 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-AttachVolumeTestJSON-11612011-project Jul 07 10:30:55.014232 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: > Jul 07 10:30:55.014232 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Instance b00a3c72-669b-41e2-a9b9-1a2921bcabe0 could not be found. Jul 07 10:30:55.014232 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'id': 'b00a3c72-669b-41e2-a9b9-1a2921bcabe0'} Jul 07 10:30:55.015691 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:30:55.015691 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:30:55.015691 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:30:55.015691 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:30:55.015691 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:30:55.015691 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:30:55.015691 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:30:55.015691 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:30:55.015691 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:30:55.015691 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:30:55.015691 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b00a3c72-669b-41e2-a9b9-1a2921bcabe0 could not be found. Jul 07 10:30:55.015691 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:30:55.015691 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:30:55.015691 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:30:55.015691 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:30:55.015691 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:30:55.015691 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:30:55.015691 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:30:55.015691 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:30:55.015691 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:30:55.017155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:30:55.017155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:30:55.017155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:30:55.017155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:30:55.017155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:30:55.017155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:30:55.017155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:30:55.017155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b00a3c72-669b-41e2-a9b9-1a2921bcabe0 could not be found. Jul 07 10:30:55.017155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:30:55.017155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:30:55.017155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:30:55.017155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:30:55.017155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:30:55.017155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:30:55.017155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:30:55.017155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:30:55.017155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b00a3c72-669b-41e2-a9b9-1a2921bcabe0 could not be found. Jul 07 10:30:55.017155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:30:55.018769 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a92e6a9b-b478-44e6-b54c-cb8fec2c5671 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Returning 404 to user: Instance b00a3c72-669b-41e2-a9b9-1a2921bcabe0 could not be found. {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:30:55.018769 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-a92e6a9b-b478-44e6-b54c-cb8fec2c5671 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 404 len: 111 microversion: 2.1 time: 0.037062 Jul 07 10:30:55.018769 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 295/568] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:54 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:30:55.025193 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9123d9bd-84d3-4302-a044-e200902337dd tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '.version_select at 0x7f9e9e336280>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:55.043260 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9123d9bd-84d3-4302-a044-e200902337dd tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054132931" status: 202 len: 0 microversion: 2.1 time: 0.022726 Jul 07 10:30:55.044520 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 274/569] 10.222.0.16 () {58 vars in 1220 bytes} [Thu Jul 7 10:30:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054132931 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 10:30:55.689482 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-0dd20cee-25cc-4554-ace0-07b9e6ad2816 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Action: 'create', calling method: .version_select at 0x7f9e9e629550>, body: {"keypair": {"name": "tempest-keypair-1210705166", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2dq+6uH+9I5e9O/a3h2lWMdDgJNVUXCsimB5h+qbzKk5DZ3CqyxXpX/E46zRZL1pOqzvqZ1qXWH8tLG0xOtsU6h5BHFd2zhib7jPn401W21Aykco5iWRuZ3gB38eNv6g=="}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:30:55.703502 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-0dd20cee-25cc-4554-ace0-07b9e6ad2816 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Getting quotas for project 98924fde961c41358ffb24ac3819557a. Resources: {'key_pairs'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:30:55.707254 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-0dd20cee-25cc-4554-ace0-07b9e6ad2816 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Getting quotas for user 247787cd745444f38953a64780d6ac9b and project 98924fde961c41358ffb24ac3819557a. Resources: {'key_pairs'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:30:55.730663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-0dd20cee-25cc-4554-ace0-07b9e6ad2816 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044990 Jul 07 10:30:55.731320 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 296/570] 10.222.0.16 () {60 vars in 1158 bytes} [Thu Jul 7 10:30:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:30:57.228856 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c10eb5a8-3f22-4310-bd80-1fac746ae785 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-679319203", "imageRef": "1c96509d-f65f-42b0-94b3-6fc590a93508", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b08fa55b-4190-4e6d-8467-4b3e6107ca87"}], "security_groups": [{"name": "tempest-securitygroup--1348858506"}], "key_name": "tempest-keypair-1210705166", "user_data": "}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:30:57.330588 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.network.neutron [None req-c10eb5a8-3f22-4310-bd80-1fac746ae785 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] validate_networks() for [('b08fa55b-4190-4e6d-8467-4b3e6107ca87', None, None, None, None, None)] {{(pid=117647) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 10:30:57.698526 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-c10eb5a8-3f22-4310-bd80-1fac746ae785 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Flavor limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 10:30:57.698943 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-c10eb5a8-3f22-4310-bd80-1fac746ae785 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Image limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 10:30:57.699414 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-c10eb5a8-3f22-4310-bd80-1fac746ae785 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Flavor pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 10:30:57.699854 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-c10eb5a8-3f22-4310-bd80-1fac746ae785 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Image pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 10:30:57.700260 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-c10eb5a8-3f22-4310-bd80-1fac746ae785 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 10:30:57.708870 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c10eb5a8-3f22-4310-bd80-1fac746ae785 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:57.709975 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c10eb5a8-3f22-4310-bd80-1fac746ae785 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:57.710770 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c10eb5a8-3f22-4310-bd80-1fac746ae785 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:57.711198 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c10eb5a8-3f22-4310-bd80-1fac746ae785 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:57.727202 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-c10eb5a8-3f22-4310-bd80-1fac746ae785 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Getting quotas for project 98924fde961c41358ffb24ac3819557a. Resources: {'cores', 'ram', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:30:57.731100 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-c10eb5a8-3f22-4310-bd80-1fac746ae785 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Getting quotas for user 247787cd745444f38953a64780d6ac9b and project 98924fde961c41358ffb24ac3819557a. Resources: {'cores', 'ram', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:30:57.741769 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c10eb5a8-3f22-4310-bd80-1fac746ae785 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Going to run 1 instances... {{(pid=117647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 10:30:57.744073 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c10eb5a8-3f22-4310-bd80-1fac746ae785 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c96509d-f65f-42b0-94b3-6fc590a93508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 10:30:57.789117 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c10eb5a8-3f22-4310-bd80-1fac746ae785 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.565615 Jul 07 10:30:57.789759 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 275/571] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jul 7 10:30:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 10:30:57.799734 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-3fca7eef-2464-4b99-b6ca-40dd1ce0f497 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:57.800369 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-3fca7eef-2464-4b99-b6ca-40dd1ce0f497 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:57.857824 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-3fca7eef-2464-4b99-b6ca-40dd1ce0f497 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:57.864486 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-3fca7eef-2464-4b99-b6ca-40dd1ce0f497 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba" status: 200 len: 1237 microversion: 2.1 time: 0.068522 Jul 07 10:30:57.865048 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 297/572] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:57 2022] GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:58.882188 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c3450dba-bc35-4391-b745-f0483984859c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:58.882880 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c3450dba-bc35-4391-b745-f0483984859c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:58.889638 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c3450dba-bc35-4391-b745-f0483984859c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:58.890146 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c3450dba-bc35-4391-b745-f0483984859c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:58.891155 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c3450dba-bc35-4391-b745-f0483984859c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:58.891599 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c3450dba-bc35-4391-b745-f0483984859c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:58.963617 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c3450dba-bc35-4391-b745-f0483984859c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:30:58.971134 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c3450dba-bc35-4391-b745-f0483984859c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba" status: 200 len: 1295 microversion: 2.1 time: 0.093307 Jul 07 10:30:58.971694 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 276/573] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:58 2022] GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba => generated 1295 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:30:59.989337 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a2319ae4-b3c8-4966-81f1-dae176a1acf0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:30:59.989963 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-a2319ae4-b3c8-4966-81f1-dae176a1acf0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:30:59.997206 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a2319ae4-b3c8-4966-81f1-dae176a1acf0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:30:59.998250 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a2319ae4-b3c8-4966-81f1-dae176a1acf0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:30:59.999271 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a2319ae4-b3c8-4966-81f1-dae176a1acf0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:00.000339 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a2319ae4-b3c8-4966-81f1-dae176a1acf0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:00.149971 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-a2319ae4-b3c8-4966-81f1-dae176a1acf0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:00.160138 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-a2319ae4-b3c8-4966-81f1-dae176a1acf0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba" status: 200 len: 1363 microversion: 2.1 time: 0.174695 Jul 07 10:31:00.161634 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 298/574] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:30:59 2022] GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:00.343157 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-fec5d422-4ce5-4727-807e-1f1f9443fe55 req-3358d963-f158-436e-8745-0d5813805b71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c12068c-75fc-441d-872b-046be6efeeba", "tag": "bad5fc6c-9e27-456d-9310-528cd132eb27"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:31:00.353461 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-fec5d422-4ce5-4727-807e-1f1f9443fe55 req-3358d963-f158-436e-8745-0d5813805b71 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:00.354269 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-fec5d422-4ce5-4727-807e-1f1f9443fe55 req-3358d963-f158-436e-8745-0d5813805b71 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:00.369675 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-fec5d422-4ce5-4727-807e-1f1f9443fe55 req-3358d963-f158-436e-8745-0d5813805b71 service nova] Creating event network-changed:bad5fc6c-9e27-456d-9310-528cd132eb27 for instance 4c12068c-75fc-441d-872b-046be6efeeba on hv-cinder-82282 Jul 07 10:31:00.374643 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-fec5d422-4ce5-4727-807e-1f1f9443fe55 req-3358d963-f158-436e-8745-0d5813805b71 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035322 Jul 07 10:31:00.375964 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 277/575] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:31:01.177026 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-f4ea8736-b890-4ae0-bc49-0c985abff6cc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:01.177626 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-f4ea8736-b890-4ae0-bc49-0c985abff6cc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:01.184044 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f4ea8736-b890-4ae0-bc49-0c985abff6cc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:01.184499 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f4ea8736-b890-4ae0-bc49-0c985abff6cc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:01.185259 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f4ea8736-b890-4ae0-bc49-0c985abff6cc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:01.185698 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f4ea8736-b890-4ae0-bc49-0c985abff6cc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:01.312919 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-f4ea8736-b890-4ae0-bc49-0c985abff6cc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:01.321098 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-f4ea8736-b890-4ae0-bc49-0c985abff6cc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba" status: 200 len: 1363 microversion: 2.1 time: 0.148000 Jul 07 10:31:01.321657 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 299/576] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:01 2022] GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:02.338561 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d829f974-c7ac-4962-a6f6-ea2a65cadc03 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:02.339258 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d829f974-c7ac-4962-a6f6-ea2a65cadc03 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:02.345432 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d829f974-c7ac-4962-a6f6-ea2a65cadc03 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:02.345903 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d829f974-c7ac-4962-a6f6-ea2a65cadc03 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:02.346660 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d829f974-c7ac-4962-a6f6-ea2a65cadc03 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:02.347101 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d829f974-c7ac-4962-a6f6-ea2a65cadc03 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:02.476813 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d829f974-c7ac-4962-a6f6-ea2a65cadc03 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:02.484404 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d829f974-c7ac-4962-a6f6-ea2a65cadc03 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba" status: 200 len: 1363 microversion: 2.1 time: 0.150481 Jul 07 10:31:02.484968 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 278/577] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:02 2022] GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:03.501687 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-31e5339c-62db-484d-9889-f901a9dda404 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:03.505441 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-31e5339c-62db-484d-9889-f901a9dda404 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:03.508940 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-31e5339c-62db-484d-9889-f901a9dda404 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:03.509385 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-31e5339c-62db-484d-9889-f901a9dda404 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:03.510174 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-31e5339c-62db-484d-9889-f901a9dda404 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:03.510605 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-31e5339c-62db-484d-9889-f901a9dda404 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:03.637278 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-31e5339c-62db-484d-9889-f901a9dda404 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:03.645118 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-31e5339c-62db-484d-9889-f901a9dda404 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba" status: 200 len: 1363 microversion: 2.1 time: 0.147283 Jul 07 10:31:03.645734 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 300/578] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:03 2022] GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:04.662963 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-09230b9c-6514-4919-904c-2a4f8c8328ae tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:04.663604 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-09230b9c-6514-4919-904c-2a4f8c8328ae tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:04.670056 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-09230b9c-6514-4919-904c-2a4f8c8328ae tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:04.670510 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-09230b9c-6514-4919-904c-2a4f8c8328ae tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:04.671266 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-09230b9c-6514-4919-904c-2a4f8c8328ae tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:04.671702 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-09230b9c-6514-4919-904c-2a4f8c8328ae tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:04.801583 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-09230b9c-6514-4919-904c-2a4f8c8328ae tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:04.808933 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-09230b9c-6514-4919-904c-2a4f8c8328ae tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba" status: 200 len: 1363 microversion: 2.1 time: 0.150395 Jul 07 10:31:04.809496 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 279/579] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:04 2022] GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:05.221674 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-8f387374-368a-4d96-a2be-605b4af7c5a6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:05.222161 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-8f387374-368a-4d96-a2be-605b4af7c5a6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:05.228671 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8f387374-368a-4d96-a2be-605b4af7c5a6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:05.229122 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8f387374-368a-4d96-a2be-605b4af7c5a6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:05.229878 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8f387374-368a-4d96-a2be-605b4af7c5a6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:05.230315 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8f387374-368a-4d96-a2be-605b4af7c5a6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:05.307757 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.objects.instance [None req-8f387374-368a-4d96-a2be-605b4af7c5a6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lazy-loading 'services' on Instance uuid 5080ca5c-bf77-4305-877b-c992e9248b40 {{(pid=117646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 10:31:05.376931 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-8f387374-368a-4d96-a2be-605b4af7c5a6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40/os-volume_attachments/18922aeb-89a6-4ca9-8598-fdefb4ef3f64" status: 202 len: 0 microversion: 2.1 time: 0.159056 Jul 07 10:31:05.377507 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 301/580] 10.222.0.16 () {58 vars in 1415 bytes} [Thu Jul 7 10:31:05 2022] DELETE /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40/os-volume_attachments/18922aeb-89a6-4ca9-8598-fdefb4ef3f64 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 10:31:05.386400 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-59d2fbe4-29dd-4f1c-bd55-8fbd8aadf4b9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:05.387330 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-59d2fbe4-29dd-4f1c-bd55-8fbd8aadf4b9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:05.393756 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-59d2fbe4-29dd-4f1c-bd55-8fbd8aadf4b9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:05.394265 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-59d2fbe4-29dd-4f1c-bd55-8fbd8aadf4b9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:05.395013 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-59d2fbe4-29dd-4f1c-bd55-8fbd8aadf4b9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:05.395457 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-59d2fbe4-29dd-4f1c-bd55-8fbd8aadf4b9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:05.425079 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-59d2fbe4-29dd-4f1c-bd55-8fbd8aadf4b9 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042541 Jul 07 10:31:05.425642 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 280/581] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jul 7 10:31:05 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:31:05.826436 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a849065e-7806-483b-a2dc-33a6c034faea tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:05.827129 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-a849065e-7806-483b-a2dc-33a6c034faea tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:05.833421 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a849065e-7806-483b-a2dc-33a6c034faea tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:05.833874 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a849065e-7806-483b-a2dc-33a6c034faea tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:05.834629 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a849065e-7806-483b-a2dc-33a6c034faea tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:05.835063 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a849065e-7806-483b-a2dc-33a6c034faea tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:05.964115 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-a849065e-7806-483b-a2dc-33a6c034faea tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:05.971647 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-a849065e-7806-483b-a2dc-33a6c034faea tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba" status: 200 len: 1363 microversion: 2.1 time: 0.149516 Jul 07 10:31:05.972248 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 302/582] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:05 2022] GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:06.155169 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-d1fe943b-b71f-493f-a250-b3e81d10cef7 req-f95da05b-c559-4f36-ba4a-616d0e12609e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c12068c-75fc-441d-872b-046be6efeeba", "name": "network-vif-plugged", "status": "completed", "tag": "bad5fc6c-9e27-456d-9310-528cd132eb27"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:31:06.164876 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-d1fe943b-b71f-493f-a250-b3e81d10cef7 req-f95da05b-c559-4f36-ba4a-616d0e12609e service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:06.165344 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-d1fe943b-b71f-493f-a250-b3e81d10cef7 req-f95da05b-c559-4f36-ba4a-616d0e12609e service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:06.177100 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-d1fe943b-b71f-493f-a250-b3e81d10cef7 req-f95da05b-c559-4f36-ba4a-616d0e12609e service nova] Creating event network-vif-plugged:bad5fc6c-9e27-456d-9310-528cd132eb27 for instance 4c12068c-75fc-441d-872b-046be6efeeba on hv-cinder-82282 Jul 07 10:31:06.182645 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-d1fe943b-b71f-493f-a250-b3e81d10cef7 req-f95da05b-c559-4f36-ba4a-616d0e12609e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031486 Jul 07 10:31:06.183234 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 281/583] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:31:06.436094 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-31caf6eb-5771-4637-a7fb-5309a3dd974b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:06.437116 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-31caf6eb-5771-4637-a7fb-5309a3dd974b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:06.443680 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-31caf6eb-5771-4637-a7fb-5309a3dd974b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:06.444431 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-31caf6eb-5771-4637-a7fb-5309a3dd974b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:06.445193 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-31caf6eb-5771-4637-a7fb-5309a3dd974b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:06.445634 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-31caf6eb-5771-4637-a7fb-5309a3dd974b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:06.474140 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-31caf6eb-5771-4637-a7fb-5309a3dd974b tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042050 Jul 07 10:31:06.475345 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 303/584] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jul 7 10:31:06 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 10:31:06.545222 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6c3c8644-e3b3-4b63-a66a-d156ad276c58 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:06.545809 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6c3c8644-e3b3-4b63-a66a-d156ad276c58 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:06.552022 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6c3c8644-e3b3-4b63-a66a-d156ad276c58 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:06.552483 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6c3c8644-e3b3-4b63-a66a-d156ad276c58 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:06.553244 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6c3c8644-e3b3-4b63-a66a-d156ad276c58 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:06.553685 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6c3c8644-e3b3-4b63-a66a-d156ad276c58 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:06.579941 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6c3c8644-e3b3-4b63-a66a-d156ad276c58 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Going to try to terminate instance {{(pid=117647) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 10:31:06.653110 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6c3c8644-e3b3-4b63-a66a-d156ad276c58 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 204 len: 0 microversion: 2.1 time: 0.111803 Jul 07 10:31:06.653615 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 282/585] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jul 7 10:31:06 2022] DELETE /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 10:31:06.662028 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-11a81395-f621-4dc4-8273-59d0c87271f5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:06.662646 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-11a81395-f621-4dc4-8273-59d0c87271f5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:06.669521 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-11a81395-f621-4dc4-8273-59d0c87271f5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:06.669967 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-11a81395-f621-4dc4-8273-59d0c87271f5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:06.670904 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-11a81395-f621-4dc4-8273-59d0c87271f5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:06.671346 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-11a81395-f621-4dc4-8273-59d0c87271f5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:06.797337 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-11a81395-f621-4dc4-8273-59d0c87271f5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:06.804798 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-11a81395-f621-4dc4-8273-59d0c87271f5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1689 microversion: 2.1 time: 0.146972 Jul 07 10:31:06.805363 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 304/586] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:06 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1689 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:06.989274 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9ae7d0b7-6ea5-42d1-be47-46d0f1c98097 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:06.989895 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-9ae7d0b7-6ea5-42d1-be47-46d0f1c98097 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:06.996319 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9ae7d0b7-6ea5-42d1-be47-46d0f1c98097 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:06.996763 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9ae7d0b7-6ea5-42d1-be47-46d0f1c98097 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:06.997513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9ae7d0b7-6ea5-42d1-be47-46d0f1c98097 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:06.997942 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9ae7d0b7-6ea5-42d1-be47-46d0f1c98097 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:07.123528 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9ae7d0b7-6ea5-42d1-be47-46d0f1c98097 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:07.131446 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9ae7d0b7-6ea5-42d1-be47-46d0f1c98097 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba" status: 200 len: 1363 microversion: 2.1 time: 0.145815 Jul 07 10:31:07.132351 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 283/587] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:06 2022] GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:07.822019 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-ebb66355-bd14-4910-ad02-62d918fcdd2d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:07.822654 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-ebb66355-bd14-4910-ad02-62d918fcdd2d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:07.829119 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ebb66355-bd14-4910-ad02-62d918fcdd2d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:07.829594 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ebb66355-bd14-4910-ad02-62d918fcdd2d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:07.830346 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ebb66355-bd14-4910-ad02-62d918fcdd2d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:07.830779 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ebb66355-bd14-4910-ad02-62d918fcdd2d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:07.862327 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell0:SELECT=6 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:31:07.956780 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-ebb66355-bd14-4910-ad02-62d918fcdd2d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:07.964645 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-ebb66355-bd14-4910-ad02-62d918fcdd2d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1689 microversion: 2.1 time: 0.146776 Jul 07 10:31:07.965206 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 305/588] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:07 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1689 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:08.148482 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5801b638-6333-44d8-85e7-68b72a00a3f5 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:08.149303 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5801b638-6333-44d8-85e7-68b72a00a3f5 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:08.152228 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:31:08.153096 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=6 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:31:08.159865 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5801b638-6333-44d8-85e7-68b72a00a3f5 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:08.160326 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5801b638-6333-44d8-85e7-68b72a00a3f5 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:08.161097 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5801b638-6333-44d8-85e7-68b72a00a3f5 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:08.161545 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5801b638-6333-44d8-85e7-68b72a00a3f5 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:08.291181 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5801b638-6333-44d8-85e7-68b72a00a3f5 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:08.298577 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5801b638-6333-44d8-85e7-68b72a00a3f5 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba" status: 200 len: 1363 microversion: 2.1 time: 0.154618 Jul 07 10:31:08.299148 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 284/589] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:08 2022] GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:08.980733 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-6feed384-522c-47c0-8c29-35ea19dd792a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:08.981366 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-6feed384-522c-47c0-8c29-35ea19dd792a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:08.987724 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6feed384-522c-47c0-8c29-35ea19dd792a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:08.988199 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6feed384-522c-47c0-8c29-35ea19dd792a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:08.988950 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6feed384-522c-47c0-8c29-35ea19dd792a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:08.989384 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6feed384-522c-47c0-8c29-35ea19dd792a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:09.121227 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-6feed384-522c-47c0-8c29-35ea19dd792a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:09.128598 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-6feed384-522c-47c0-8c29-35ea19dd792a tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1689 microversion: 2.1 time: 0.151703 Jul 07 10:31:09.129166 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 306/590] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:08 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:31:09.315137 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2446f4a6-a9d7-459f-b422-b47c3fd29472 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:09.315804 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-2446f4a6-a9d7-459f-b422-b47c3fd29472 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:09.323088 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2446f4a6-a9d7-459f-b422-b47c3fd29472 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:09.323536 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2446f4a6-a9d7-459f-b422-b47c3fd29472 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:09.324328 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2446f4a6-a9d7-459f-b422-b47c3fd29472 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:09.324767 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2446f4a6-a9d7-459f-b422-b47c3fd29472 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:09.449860 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-2446f4a6-a9d7-459f-b422-b47c3fd29472 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:09.457222 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-2446f4a6-a9d7-459f-b422-b47c3fd29472 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba" status: 200 len: 1363 microversion: 2.1 time: 0.145912 Jul 07 10:31:09.457790 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 285/591] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:09 2022] GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:10.145897 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-eb2f823c-9e7c-40d3-bcdb-2a75365fe09d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:10.147003 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-eb2f823c-9e7c-40d3-bcdb-2a75365fe09d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:10.153582 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-eb2f823c-9e7c-40d3-bcdb-2a75365fe09d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:10.154089 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-eb2f823c-9e7c-40d3-bcdb-2a75365fe09d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:10.154856 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-eb2f823c-9e7c-40d3-bcdb-2a75365fe09d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:10.155295 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-eb2f823c-9e7c-40d3-bcdb-2a75365fe09d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:10.279707 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-eb2f823c-9e7c-40d3-bcdb-2a75365fe09d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:10.287764 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-eb2f823c-9e7c-40d3-bcdb-2a75365fe09d tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1689 microversion: 2.1 time: 0.145166 Jul 07 10:31:10.288327 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 307/592] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:10 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1689 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:10.473919 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9af90fc1-9087-4d89-895e-072b81094b51 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:10.475026 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-9af90fc1-9087-4d89-895e-072b81094b51 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:10.481583 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9af90fc1-9087-4d89-895e-072b81094b51 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:10.481981 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9af90fc1-9087-4d89-895e-072b81094b51 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:10.482738 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9af90fc1-9087-4d89-895e-072b81094b51 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:10.483175 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9af90fc1-9087-4d89-895e-072b81094b51 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:10.611051 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9af90fc1-9087-4d89-895e-072b81094b51 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:10.614449 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:31:10.619779 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9af90fc1-9087-4d89-895e-072b81094b51 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba" status: 200 len: 1363 microversion: 2.1 time: 0.149705 Jul 07 10:31:10.620346 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 286/593] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:10 2022] GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:11.305813 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-4a2212d2-9d31-411b-8972-531bca72be42 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:11.306549 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-4a2212d2-9d31-411b-8972-531bca72be42 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:11.313646 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4a2212d2-9d31-411b-8972-531bca72be42 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:11.314249 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4a2212d2-9d31-411b-8972-531bca72be42 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:11.315107 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4a2212d2-9d31-411b-8972-531bca72be42 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:11.315592 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4a2212d2-9d31-411b-8972-531bca72be42 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:11.460795 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-4a2212d2-9d31-411b-8972-531bca72be42 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:11.468138 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-4a2212d2-9d31-411b-8972-531bca72be42 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 200 len: 1689 microversion: 2.1 time: 0.167409 Jul 07 10:31:11.468703 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 308/594] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:11 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:11.637265 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c10f4a1d-eb3d-4b49-86ec-19c40f69c506 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:11.637887 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c10f4a1d-eb3d-4b49-86ec-19c40f69c506 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:11.644613 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c10f4a1d-eb3d-4b49-86ec-19c40f69c506 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:11.645071 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c10f4a1d-eb3d-4b49-86ec-19c40f69c506 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:11.645854 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c10f4a1d-eb3d-4b49-86ec-19c40f69c506 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:11.646322 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c10f4a1d-eb3d-4b49-86ec-19c40f69c506 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:11.684178 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-23c95acf-bd15-4872-a5ff-f70d9eb5ea09 req-d9884492-3d6f-40de-b77c-1c050b90c6bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5080ca5c-bf77-4305-877b-c992e9248b40", "name": "network-vif-deleted", "tag": "f2d0b2c3-ea20-4eea-87fe-434f9d0de45e"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:31:11.692477 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-23c95acf-bd15-4872-a5ff-f70d9eb5ea09 req-d9884492-3d6f-40de-b77c-1c050b90c6bf service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:11.694158 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-23c95acf-bd15-4872-a5ff-f70d9eb5ea09 req-d9884492-3d6f-40de-b77c-1c050b90c6bf service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:11.710727 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-23c95acf-bd15-4872-a5ff-f70d9eb5ea09 req-d9884492-3d6f-40de-b77c-1c050b90c6bf service nova] Creating event network-vif-deleted:f2d0b2c3-ea20-4eea-87fe-434f9d0de45e for instance 5080ca5c-bf77-4305-877b-c992e9248b40 on hv-cinder-82282 Jul 07 10:31:11.718346 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-23c95acf-bd15-4872-a5ff-f70d9eb5ea09 req-d9884492-3d6f-40de-b77c-1c050b90c6bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037658 Jul 07 10:31:11.719148 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 309/595] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 10:31:11.813338 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c10f4a1d-eb3d-4b49-86ec-19c40f69c506 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:11.823371 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c10f4a1d-eb3d-4b49-86ec-19c40f69c506 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba" status: 200 len: 1549 microversion: 2.1 time: 0.189940 Jul 07 10:31:11.827903 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 287/596] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:11 2022] GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba => generated 1549 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:11.847043 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-bd0b4866-39f5-49d9-94cc-29b92638b1fc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:11.847639 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-bd0b4866-39f5-49d9-94cc-29b92638b1fc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:11.855393 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bd0b4866-39f5-49d9-94cc-29b92638b1fc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:11.855983 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bd0b4866-39f5-49d9-94cc-29b92638b1fc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:11.856902 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bd0b4866-39f5-49d9-94cc-29b92638b1fc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:11.857335 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bd0b4866-39f5-49d9-94cc-29b92638b1fc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:11.861651 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:31:11.941159 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-bd0b4866-39f5-49d9-94cc-29b92638b1fc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100208 Jul 07 10:31:11.941511 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 310/597] 10.222.0.16 () {58 vars in 1274 bytes} [Thu Jul 7 10:31:11 2022] GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:31:12.484979 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8d93074f-2e30-4ce1-a8fe-b55e5ded9739 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:12.485828 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8d93074f-2e30-4ce1-a8fe-b55e5ded9739 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 5080ca5c-bf77-4305-877b-c992e9248b40] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:12.492735 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8d93074f-2e30-4ce1-a8fe-b55e5ded9739 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:12.493192 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8d93074f-2e30-4ce1-a8fe-b55e5ded9739 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:12.493969 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8d93074f-2e30-4ce1-a8fe-b55e5ded9739 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:12.494659 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8d93074f-2e30-4ce1-a8fe-b55e5ded9739 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:12.512068 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-8d93074f-2e30-4ce1-a8fe-b55e5ded9739 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] HTTP exception thrown: Instance 5080ca5c-bf77-4305-877b-c992e9248b40 could not be found. Jul 07 10:31:12.514017 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8d93074f-2e30-4ce1-a8fe-b55e5ded9739 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Request method failure captured: Jul 07 10:31:12.514017 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 HTTP/1.1 Jul 07 10:31:12.514017 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept: application/json Jul 07 10:31:12.514017 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jul 07 10:31:12.514017 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Connection: close Jul 07 10:31:12.514017 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jul 07 10:31:12.514017 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jul 07 10:31:12.514017 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Host: 10.222.0.16 Jul 07 10:31:12.514017 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jul 07 10:31:12.514017 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jul 07 10:31:12.514017 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABixrS4oJkiQJ2S1nuTus8_u0pgmHtb2UVNyGp6_ugxW7QSRm-iSt8LOJAKl2ypHUM-taYWb6Bei6nHqf_-zMcUYULB9JjdSQtGpTGJBQ6G69lQK9O9rW3T1MeoKBWymStKrelTWl9C3QobvGGNXcuc-HNij8n2XMYSmetxBRApxPwJ7WE Jul 07 10:31:12.514017 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jul 07 10:31:12.514017 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jul 07 10:31:12.514017 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jul 07 10:31:12.514017 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jul 07 10:31:12.514017 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jul 07 10:31:12.514017 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jul 07 10:31:12.514017 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Id: 0a883b49db0f4f32a32bf6d87e2f6104 Jul 07 10:31:12.514017 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1851522730 Jul 07 10:31:12.514017 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jul 07 10:31:12.514017 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jul 07 10:31:12.515382 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a883b49db0f4f32a32bf6d87e2f6104"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0a883b49db0f4f32a32bf6d87e2f6104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a883b49db0f4f32a32bf6d87e2f6104"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0a883b49db0f4f32a32bf6d87e2f6104"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:31:12.515382 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1851522730 Jul 07 10:31:12.515382 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 0a883b49db0f4f32a32bf6d87e2f6104 Jul 07 10:31:12.515382 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1851522730 Jul 07 10:31:12.515382 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User: tempest-ServerRescueNegativeTestJSON-1851522730-project Jul 07 10:31:12.515382 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jul 07 10:31:12.515382 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jul 07 10:31:12.515382 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Id: 92b758b22f054dd991e8af99354a134f Jul 07 10:31:12.515382 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1851522730-project Jul 07 10:31:12.515382 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: method: > Jul 07 10:31:12.515382 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: exception: Instance 5080ca5c-bf77-4305-877b-c992e9248b40 could not be found. Jul 07 10:31:12.515382 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: action_args: {'id': '5080ca5c-bf77-4305-877b-c992e9248b40'} Jul 07 10:31:12.516188 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:31:12.516188 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:31:12.516188 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:31:12.516188 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:31:12.516188 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:31:12.516188 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:31:12.516188 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:31:12.516188 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:31:12.516188 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:31:12.516188 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:31:12.516188 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5080ca5c-bf77-4305-877b-c992e9248b40 could not be found. Jul 07 10:31:12.516188 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:31:12.516188 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:31:12.516188 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:31:12.516188 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:31:12.516188 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:31:12.516188 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:31:12.516188 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:31:12.516188 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:31:12.516188 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:31:12.517407 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:31:12.517407 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:31:12.517407 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:31:12.517407 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:31:12.517407 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:31:12.517407 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:31:12.517407 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:31:12.517407 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5080ca5c-bf77-4305-877b-c992e9248b40 could not be found. Jul 07 10:31:12.517407 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:31:12.517407 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:31:12.517407 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:31:12.517407 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:31:12.517407 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:31:12.517407 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:31:12.517407 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:31:12.517407 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:31:12.517407 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5080ca5c-bf77-4305-877b-c992e9248b40 could not be found. Jul 07 10:31:12.517407 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:31:12.520207 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8d93074f-2e30-4ce1-a8fe-b55e5ded9739 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Returning 404 to user: Instance 5080ca5c-bf77-4305-877b-c992e9248b40 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:31:12.522032 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8d93074f-2e30-4ce1-a8fe-b55e5ded9739 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40" status: 404 len: 111 microversion: 2.1 time: 0.040327 Jul 07 10:31:12.522823 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 288/598] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:12 2022] GET /compute/v2.1/servers/5080ca5c-bf77-4305-877b-c992e9248b40 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:31:12.532219 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-3d105f33-95ba-4a11-919e-457475a41ba3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '.version_select at 0x7f9e9e5fb280>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:12.554712 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-3d105f33-95ba-4a11-919e-457475a41ba3 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1430372133" status: 202 len: 0 microversion: 2.1 time: 0.026789 Jul 07 10:31:12.558637 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 311/599] 10.222.0.16 () {58 vars in 1220 bytes} [Thu Jul 7 10:31:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1430372133 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 10:31:12.923560 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-2856b93f-de77-4f44-a532-2c93868fd9a0 req-4941e9eb-478c-4109-83e3-9f591c52b63d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c12068c-75fc-441d-872b-046be6efeeba", "tag": "bad5fc6c-9e27-456d-9310-528cd132eb27"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:31:12.932923 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-2856b93f-de77-4f44-a532-2c93868fd9a0 req-4941e9eb-478c-4109-83e3-9f591c52b63d service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:12.933368 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-2856b93f-de77-4f44-a532-2c93868fd9a0 req-4941e9eb-478c-4109-83e3-9f591c52b63d service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:12.945634 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-2856b93f-de77-4f44-a532-2c93868fd9a0 req-4941e9eb-478c-4109-83e3-9f591c52b63d service nova] Creating event network-changed:bad5fc6c-9e27-456d-9310-528cd132eb27 for instance 4c12068c-75fc-441d-872b-046be6efeeba on hv-cinder-82282 Jul 07 10:31:12.950845 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-2856b93f-de77-4f44-a532-2c93868fd9a0 req-4941e9eb-478c-4109-83e3-9f591c52b63d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030761 Jul 07 10:31:12.951730 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 289/600] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:31:15.663104 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-737e21c3-b800-4f43-bc36-569815a232b5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:15.663604 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-737e21c3-b800-4f43-bc36-569815a232b5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:15.670923 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-737e21c3-b800-4f43-bc36-569815a232b5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:15.671381 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-737e21c3-b800-4f43-bc36-569815a232b5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:15.672173 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-737e21c3-b800-4f43-bc36-569815a232b5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:15.672616 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-737e21c3-b800-4f43-bc36-569815a232b5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:15.696971 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-737e21c3-b800-4f43-bc36-569815a232b5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Going to try to terminate instance {{(pid=117646) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 10:31:15.770373 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-737e21c3-b800-4f43-bc36-569815a232b5 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "DELETE /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 204 len: 0 microversion: 2.1 time: 0.111230 Jul 07 10:31:15.771291 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 312/601] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jul 7 10:31:15 2022] DELETE /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 10:31:15.781000 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c1c8e26c-b89d-4c2c-bb9f-0494ae69dfbf tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:15.781702 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c1c8e26c-b89d-4c2c-bb9f-0494ae69dfbf tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:15.788291 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c1c8e26c-b89d-4c2c-bb9f-0494ae69dfbf tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:15.788740 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c1c8e26c-b89d-4c2c-bb9f-0494ae69dfbf tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:15.789491 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c1c8e26c-b89d-4c2c-bb9f-0494ae69dfbf tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:15.789923 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c1c8e26c-b89d-4c2c-bb9f-0494ae69dfbf tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:15.916395 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c1c8e26c-b89d-4c2c-bb9f-0494ae69dfbf tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:15.923716 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c1c8e26c-b89d-4c2c-bb9f-0494ae69dfbf tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1508 microversion: 2.1 time: 0.147787 Jul 07 10:31:15.924295 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 290/602] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:15 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:16.941822 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-3e7065fb-6234-4cda-ac21-3bbcb6dada99 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:16.942539 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-3e7065fb-6234-4cda-ac21-3bbcb6dada99 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:16.949823 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3e7065fb-6234-4cda-ac21-3bbcb6dada99 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:16.950269 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3e7065fb-6234-4cda-ac21-3bbcb6dada99 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:16.951025 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3e7065fb-6234-4cda-ac21-3bbcb6dada99 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:16.951461 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3e7065fb-6234-4cda-ac21-3bbcb6dada99 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:17.077681 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-3e7065fb-6234-4cda-ac21-3bbcb6dada99 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:17.085191 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-3e7065fb-6234-4cda-ac21-3bbcb6dada99 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1508 microversion: 2.1 time: 0.147651 Jul 07 10:31:17.085760 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 313/603] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:16 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:18.101233 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-78ad09ba-f174-4a14-b070-9391937e8555 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:18.101854 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-78ad09ba-f174-4a14-b070-9391937e8555 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:18.108431 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-78ad09ba-f174-4a14-b070-9391937e8555 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:18.108883 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-78ad09ba-f174-4a14-b070-9391937e8555 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:18.109689 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-78ad09ba-f174-4a14-b070-9391937e8555 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:18.110105 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-78ad09ba-f174-4a14-b070-9391937e8555 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:18.340929 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-78ad09ba-f174-4a14-b070-9391937e8555 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:18.349708 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-78ad09ba-f174-4a14-b070-9391937e8555 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 200 len: 1508 microversion: 2.1 time: 0.251867 Jul 07 10:31:18.350717 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 291/604] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:18 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 1508 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:18.676388 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-aa87ba80-24ce-4a84-84ca-927ef190032a req-f30c609c-3698-41b2-ad56-f48b45b2bf24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e45c86-fe48-454c-8b7e-3e03765d79c1", "name": "network-vif-deleted", "tag": "3f5c850a-9465-4487-9bb2-f2d849e2ab3d"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:31:18.685522 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-aa87ba80-24ce-4a84-84ca-927ef190032a req-f30c609c-3698-41b2-ad56-f48b45b2bf24 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:18.686098 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-aa87ba80-24ce-4a84-84ca-927ef190032a req-f30c609c-3698-41b2-ad56-f48b45b2bf24 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:18.701283 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-aa87ba80-24ce-4a84-84ca-927ef190032a req-f30c609c-3698-41b2-ad56-f48b45b2bf24 service nova] Creating event network-vif-deleted:3f5c850a-9465-4487-9bb2-f2d849e2ab3d for instance 08e45c86-fe48-454c-8b7e-3e03765d79c1 on hv-cinder-82282 Jul 07 10:31:18.706615 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-aa87ba80-24ce-4a84-84ca-927ef190032a req-f30c609c-3698-41b2-ad56-f48b45b2bf24 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033776 Jul 07 10:31:18.707767 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 314/605] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:31:19.367569 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d3f8d97c-ad15-4c53-97b7-4e51a90f2966 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:19.368227 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d3f8d97c-ad15-4c53-97b7-4e51a90f2966 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 08e45c86-fe48-454c-8b7e-3e03765d79c1] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:19.370633 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:31:19.375893 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d3f8d97c-ad15-4c53-97b7-4e51a90f2966 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:19.376347 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d3f8d97c-ad15-4c53-97b7-4e51a90f2966 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:19.377101 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d3f8d97c-ad15-4c53-97b7-4e51a90f2966 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:19.377536 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d3f8d97c-ad15-4c53-97b7-4e51a90f2966 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:19.392502 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-d3f8d97c-ad15-4c53-97b7-4e51a90f2966 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] HTTP exception thrown: Instance 08e45c86-fe48-454c-8b7e-3e03765d79c1 could not be found. Jul 07 10:31:19.394093 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d3f8d97c-ad15-4c53-97b7-4e51a90f2966 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Request method failure captured: Jul 07 10:31:19.394093 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 HTTP/1.1 Jul 07 10:31:19.394093 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept: application/json Jul 07 10:31:19.394093 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jul 07 10:31:19.394093 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Connection: close Jul 07 10:31:19.394093 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jul 07 10:31:19.394093 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jul 07 10:31:19.394093 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Host: 10.222.0.16 Jul 07 10:31:19.394093 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jul 07 10:31:19.394093 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jul 07 10:31:19.394093 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABixrS4oJkiQJ2S1nuTus8_u0pgmHtb2UVNyGp6_ugxW7QSRm-iSt8LOJAKl2ypHUM-taYWb6Bei6nHqf_-zMcUYULB9JjdSQtGpTGJBQ6G69lQK9O9rW3T1MeoKBWymStKrelTWl9C3QobvGGNXcuc-HNij8n2XMYSmetxBRApxPwJ7WE Jul 07 10:31:19.394093 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jul 07 10:31:19.394093 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jul 07 10:31:19.394093 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jul 07 10:31:19.394093 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jul 07 10:31:19.394093 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jul 07 10:31:19.394093 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jul 07 10:31:19.394093 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Id: 0a883b49db0f4f32a32bf6d87e2f6104 Jul 07 10:31:19.394093 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1851522730 Jul 07 10:31:19.394093 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jul 07 10:31:19.394093 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jul 07 10:31:19.395624 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a883b49db0f4f32a32bf6d87e2f6104"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0a883b49db0f4f32a32bf6d87e2f6104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a883b49db0f4f32a32bf6d87e2f6104"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0a883b49db0f4f32a32bf6d87e2f6104"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:31:19.395624 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1851522730 Jul 07 10:31:19.395624 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 0a883b49db0f4f32a32bf6d87e2f6104 Jul 07 10:31:19.395624 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1851522730 Jul 07 10:31:19.395624 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User: tempest-ServerRescueNegativeTestJSON-1851522730-project Jul 07 10:31:19.395624 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jul 07 10:31:19.395624 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jul 07 10:31:19.395624 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Id: 92b758b22f054dd991e8af99354a134f Jul 07 10:31:19.395624 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1851522730-project Jul 07 10:31:19.395624 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: method: > Jul 07 10:31:19.395624 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: exception: Instance 08e45c86-fe48-454c-8b7e-3e03765d79c1 could not be found. Jul 07 10:31:19.395624 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: action_args: {'id': '08e45c86-fe48-454c-8b7e-3e03765d79c1'} Jul 07 10:31:19.397223 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:31:19.397223 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:31:19.397223 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:31:19.397223 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:31:19.397223 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:31:19.397223 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:31:19.397223 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:31:19.397223 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:31:19.397223 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:31:19.397223 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:31:19.397223 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08e45c86-fe48-454c-8b7e-3e03765d79c1 could not be found. Jul 07 10:31:19.397223 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:31:19.397223 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:31:19.397223 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:31:19.397223 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:31:19.397223 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:31:19.397223 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:31:19.397223 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:31:19.397223 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:31:19.397223 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:31:19.398607 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:31:19.398607 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:31:19.398607 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:31:19.398607 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:31:19.398607 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:31:19.398607 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:31:19.398607 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:31:19.398607 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08e45c86-fe48-454c-8b7e-3e03765d79c1 could not be found. Jul 07 10:31:19.398607 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:31:19.398607 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:31:19.398607 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:31:19.398607 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:31:19.398607 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:31:19.398607 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:31:19.398607 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:31:19.398607 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:31:19.398607 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08e45c86-fe48-454c-8b7e-3e03765d79c1 could not be found. Jul 07 10:31:19.398607 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:31:19.399949 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d3f8d97c-ad15-4c53-97b7-4e51a90f2966 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Returning 404 to user: Instance 08e45c86-fe48-454c-8b7e-3e03765d79c1 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:31:19.399949 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d3f8d97c-ad15-4c53-97b7-4e51a90f2966 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1" status: 404 len: 111 microversion: 2.1 time: 0.031779 Jul 07 10:31:19.399949 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 292/606] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:19 2022] GET /compute/v2.1/servers/08e45c86-fe48-454c-8b7e-3e03765d79c1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:31:19.405028 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-25df2bb2-540f-4cea-b86d-a28e1b9f07d6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:19.405611 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-25df2bb2-540f-4cea-b86d-a28e1b9f07d6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:19.407493 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:31:19.412960 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-25df2bb2-540f-4cea-b86d-a28e1b9f07d6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:19.413413 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-25df2bb2-540f-4cea-b86d-a28e1b9f07d6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:19.414208 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-25df2bb2-540f-4cea-b86d-a28e1b9f07d6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:19.414649 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-25df2bb2-540f-4cea-b86d-a28e1b9f07d6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:19.440333 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-25df2bb2-540f-4cea-b86d-a28e1b9f07d6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Going to try to terminate instance {{(pid=117646) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 10:31:19.513985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-25df2bb2-540f-4cea-b86d-a28e1b9f07d6 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f" status: 204 len: 0 microversion: 2.1 time: 0.112772 Jul 07 10:31:19.514780 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 315/607] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jul 7 10:31:19 2022] DELETE /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 10:31:19.524129 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-18a369da-8ddd-4a99-a28f-c97c90bf8ae7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:19.524748 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-18a369da-8ddd-4a99-a28f-c97c90bf8ae7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:19.530913 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-18a369da-8ddd-4a99-a28f-c97c90bf8ae7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:19.531371 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-18a369da-8ddd-4a99-a28f-c97c90bf8ae7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:19.532178 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-18a369da-8ddd-4a99-a28f-c97c90bf8ae7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:19.532624 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-18a369da-8ddd-4a99-a28f-c97c90bf8ae7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:19.663490 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-18a369da-8ddd-4a99-a28f-c97c90bf8ae7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:19.671012 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-18a369da-8ddd-4a99-a28f-c97c90bf8ae7 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f" status: 200 len: 1522 microversion: 2.1 time: 0.151874 Jul 07 10:31:19.671661 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 293/608] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:19 2022] GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:20.687934 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-3993d397-8cb2-483a-a02c-1cb0e482bd46 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:20.688624 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-3993d397-8cb2-483a-a02c-1cb0e482bd46 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:20.695208 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3993d397-8cb2-483a-a02c-1cb0e482bd46 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:20.695653 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3993d397-8cb2-483a-a02c-1cb0e482bd46 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:20.696436 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3993d397-8cb2-483a-a02c-1cb0e482bd46 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:20.696875 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3993d397-8cb2-483a-a02c-1cb0e482bd46 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:20.826572 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-3993d397-8cb2-483a-a02c-1cb0e482bd46 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:20.834482 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-3993d397-8cb2-483a-a02c-1cb0e482bd46 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f" status: 200 len: 1522 microversion: 2.1 time: 0.150822 Jul 07 10:31:20.835032 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 316/609] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:20 2022] GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:21.851161 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c0ed0214-b3e5-4987-be84-08d270dd79f8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:21.851681 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c0ed0214-b3e5-4987-be84-08d270dd79f8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:21.858327 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c0ed0214-b3e5-4987-be84-08d270dd79f8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:21.858780 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c0ed0214-b3e5-4987-be84-08d270dd79f8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:21.859536 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c0ed0214-b3e5-4987-be84-08d270dd79f8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:21.860000 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c0ed0214-b3e5-4987-be84-08d270dd79f8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:21.987535 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c0ed0214-b3e5-4987-be84-08d270dd79f8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:21.995504 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c0ed0214-b3e5-4987-be84-08d270dd79f8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f" status: 200 len: 1522 microversion: 2.1 time: 0.148343 Jul 07 10:31:21.996096 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 294/610] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:21 2022] GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:23.012253 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a758eb6a-15f3-4d01-8b45-af6946d7a992 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:23.012861 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-a758eb6a-15f3-4d01-8b45-af6946d7a992 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:23.019354 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a758eb6a-15f3-4d01-8b45-af6946d7a992 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:23.019843 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a758eb6a-15f3-4d01-8b45-af6946d7a992 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:23.020617 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a758eb6a-15f3-4d01-8b45-af6946d7a992 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:23.021056 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a758eb6a-15f3-4d01-8b45-af6946d7a992 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:23.152828 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-a758eb6a-15f3-4d01-8b45-af6946d7a992 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b758b22f054dd991e8af99354a134f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a883b49db0f4f32a32bf6d87e2f6104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:23.160247 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-a758eb6a-15f3-4d01-8b45-af6946d7a992 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f" status: 200 len: 1522 microversion: 2.1 time: 0.151931 Jul 07 10:31:23.160806 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 317/611] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:23 2022] GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:23.565800 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-1e23b2ad-825a-4459-a1b3-7beb25611dd0 req-d2ed9184-22bf-4f82-b2f4-87a597991072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a1d0d51-844a-4a45-9f11-71081578d56f", "name": "network-vif-deleted", "tag": "78fdfce4-3284-497c-b70f-045463371669"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:31:23.574662 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-1e23b2ad-825a-4459-a1b3-7beb25611dd0 req-d2ed9184-22bf-4f82-b2f4-87a597991072 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:23.575104 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-1e23b2ad-825a-4459-a1b3-7beb25611dd0 req-d2ed9184-22bf-4f82-b2f4-87a597991072 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:23.585445 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-1e23b2ad-825a-4459-a1b3-7beb25611dd0 req-d2ed9184-22bf-4f82-b2f4-87a597991072 service nova] Creating event network-vif-deleted:78fdfce4-3284-497c-b70f-045463371669 for instance 1a1d0d51-844a-4a45-9f11-71081578d56f on hv-cinder-82282 Jul 07 10:31:23.590486 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-1e23b2ad-825a-4459-a1b3-7beb25611dd0 req-d2ed9184-22bf-4f82-b2f4-87a597991072 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158652 Jul 07 10:31:23.591059 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 295/612] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:31:24.177062 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-531cba08-8a02-4106-9808-22d9f212a0d8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:24.177663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-531cba08-8a02-4106-9808-22d9f212a0d8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] [instance: 1a1d0d51-844a-4a45-9f11-71081578d56f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:24.184596 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-531cba08-8a02-4106-9808-22d9f212a0d8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:24.185040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-531cba08-8a02-4106-9808-22d9f212a0d8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:24.185818 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-531cba08-8a02-4106-9808-22d9f212a0d8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:24.186251 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-531cba08-8a02-4106-9808-22d9f212a0d8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:24.200058 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.wsgi [None req-531cba08-8a02-4106-9808-22d9f212a0d8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] HTTP exception thrown: Instance 1a1d0d51-844a-4a45-9f11-71081578d56f could not be found. Jul 07 10:31:24.201663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-531cba08-8a02-4106-9808-22d9f212a0d8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Request method failure captured: Jul 07 10:31:24.201663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f HTTP/1.1 Jul 07 10:31:24.201663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:31:24.201663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:31:24.201663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:31:24.201663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 0 Jul 07 10:31:24.201663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:31:24.201663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:31:24.201663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:31:24.201663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:31:24.201663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrS4oJkiQJ2S1nuTus8_u0pgmHtb2UVNyGp6_ugxW7QSRm-iSt8LOJAKl2ypHUM-taYWb6Bei6nHqf_-zMcUYULB9JjdSQtGpTGJBQ6G69lQK9O9rW3T1MeoKBWymStKrelTWl9C3QobvGGNXcuc-HNij8n2XMYSmetxBRApxPwJ7WE Jul 07 10:31:24.201663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:31:24.201663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:31:24.201663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:31:24.201663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:31:24.201663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:31:24.201663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:31:24.201663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: 0a883b49db0f4f32a32bf6d87e2f6104 Jul 07 10:31:24.201663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1851522730 Jul 07 10:31:24.201663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:31:24.201663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:31:24.203217 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a883b49db0f4f32a32bf6d87e2f6104"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0a883b49db0f4f32a32bf6d87e2f6104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a883b49db0f4f32a32bf6d87e2f6104"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0a883b49db0f4f32a32bf6d87e2f6104"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:31:24.203217 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1851522730 Jul 07 10:31:24.203217 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: 0a883b49db0f4f32a32bf6d87e2f6104 Jul 07 10:31:24.203217 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1851522730 Jul 07 10:31:24.203217 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-ServerRescueNegativeTestJSON-1851522730-project Jul 07 10:31:24.203217 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:31:24.203217 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:31:24.203217 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: 92b758b22f054dd991e8af99354a134f Jul 07 10:31:24.203217 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1851522730-project Jul 07 10:31:24.203217 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: > Jul 07 10:31:24.203217 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Instance 1a1d0d51-844a-4a45-9f11-71081578d56f could not be found. Jul 07 10:31:24.203217 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'id': '1a1d0d51-844a-4a45-9f11-71081578d56f'} Jul 07 10:31:24.204110 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:31:24.204110 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:31:24.204110 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:31:24.204110 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:31:24.204110 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:31:24.204110 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:31:24.204110 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:31:24.204110 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:31:24.204110 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:31:24.204110 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:31:24.204110 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a1d0d51-844a-4a45-9f11-71081578d56f could not be found. Jul 07 10:31:24.204110 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:31:24.204110 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:31:24.204110 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:31:24.204110 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:31:24.204110 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:31:24.204110 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:31:24.204110 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:31:24.204110 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:31:24.204110 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:31:24.205597 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:31:24.205597 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:31:24.205597 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:31:24.205597 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:31:24.205597 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:31:24.205597 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:31:24.205597 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:31:24.205597 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a1d0d51-844a-4a45-9f11-71081578d56f could not be found. Jul 07 10:31:24.205597 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:31:24.205597 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:31:24.205597 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:31:24.205597 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:31:24.205597 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:31:24.205597 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:31:24.205597 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:31:24.205597 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:31:24.205597 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a1d0d51-844a-4a45-9f11-71081578d56f could not be found. Jul 07 10:31:24.205597 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:31:24.207201 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-531cba08-8a02-4106-9808-22d9f212a0d8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] Returning 404 to user: Instance 1a1d0d51-844a-4a45-9f11-71081578d56f could not be found. {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:31:24.207201 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-531cba08-8a02-4106-9808-22d9f212a0d8 tempest-ServerRescueNegativeTestJSON-1851522730 tempest-ServerRescueNegativeTestJSON-1851522730-project] 10.222.0.16 "GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f" status: 404 len: 111 microversion: 2.1 time: 0.029879 Jul 07 10:31:24.207201 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 318/613] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:24 2022] GET /compute/v2.1/servers/1a1d0d51-844a-4a45-9f11-71081578d56f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:31:32.515382 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-372349ef-3923-4751-bf2b-8df29344f073 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Action: 'create', calling method: .version_select at 0x7f9e9e2f8ee0>, body: {"keypair": {"name": "tempest-keypair-777105580", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+xl7FTwhANY07LLyBS7cFy15HQeN2G6/sbJGMfGWz0l4k/go3wnWeuGzo9Twyc4+d1tUbyAm4tNGZ/Ji+OLtQPzQFgbpac4/+fsAwm5uat/rim5NRGyg1f/E6kNTSxuA=="}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:31:32.531124 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-372349ef-3923-4751-bf2b-8df29344f073 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Getting quotas for project 96923df6a03841498e3732c8504b6363. Resources: {'key_pairs'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:31:32.535139 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-372349ef-3923-4751-bf2b-8df29344f073 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Getting quotas for user 31bcb5c27d8b4ae2b9a3207fff0eabfe and project 96923df6a03841498e3732c8504b6363. Resources: {'key_pairs'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:31:32.558219 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-372349ef-3923-4751-bf2b-8df29344f073 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.167389 Jul 07 10:31:32.558828 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 296/614] 10.222.0.16 () {62 vars in 1199 bytes} [Thu Jul 7 10:31:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 169 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 07 10:31:33.808786 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-e200fab4-fe29-44c3-8855-800bd0267730 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-922023374", "imageRef": "1c96509d-f65f-42b0-94b3-6fc590a93508", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "996996e9-2cfe-410c-9ecf-b4537a28c022"}], "security_groups": [{"name": "tempest-securitygroup--1939639608"}], "key_name": "tempest-keypair-777105580", "user_data": "}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:31:33.918427 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.network.neutron [None req-e200fab4-fe29-44c3-8855-800bd0267730 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] validate_networks() for [('996996e9-2cfe-410c-9ecf-b4537a28c022', None, None, None, None, None)] {{(pid=117646) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 10:31:34.191444 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:31:34.385873 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-e200fab4-fe29-44c3-8855-800bd0267730 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Flavor limits 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 10:31:34.386574 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-e200fab4-fe29-44c3-8855-800bd0267730 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Image limits 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 10:31:34.387428 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-e200fab4-fe29-44c3-8855-800bd0267730 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Flavor pref 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 10:31:34.388725 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-e200fab4-fe29-44c3-8855-800bd0267730 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Image pref 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 10:31:34.389533 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-e200fab4-fe29-44c3-8855-800bd0267730 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 10:31:34.404132 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e200fab4-fe29-44c3-8855-800bd0267730 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:34.405048 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e200fab4-fe29-44c3-8855-800bd0267730 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:34.406427 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e200fab4-fe29-44c3-8855-800bd0267730 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:34.407135 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e200fab4-fe29-44c3-8855-800bd0267730 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:34.429960 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-e200fab4-fe29-44c3-8855-800bd0267730 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Getting quotas for project 96923df6a03841498e3732c8504b6363. Resources: {'cores', 'ram', 'instances'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:31:34.434593 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-e200fab4-fe29-44c3-8855-800bd0267730 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Getting quotas for user 31bcb5c27d8b4ae2b9a3207fff0eabfe and project 96923df6a03841498e3732c8504b6363. Resources: {'cores', 'ram', 'instances'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:31:34.448149 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-e200fab4-fe29-44c3-8855-800bd0267730 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Going to run 1 instances... {{(pid=117646) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 10:31:34.450437 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-e200fab4-fe29-44c3-8855-800bd0267730 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c96509d-f65f-42b0-94b3-6fc590a93508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 10:31:34.520882 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-e200fab4-fe29-44c3-8855-800bd0267730 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.716370 Jul 07 10:31:34.521839 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 319/615] 10.222.0.16 () {62 vars in 1187 bytes} [Thu Jul 7 10:31:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 07 10:31:34.529543 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=38 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:31:34.536374 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5e3b71c1-4def-4bfe-acb3-a6afe7f66329 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:34.537502 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5e3b71c1-4def-4bfe-acb3-a6afe7f66329 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:34.634565 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5e3b71c1-4def-4bfe-acb3-a6afe7f66329 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:34.642655 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5e3b71c1-4def-4bfe-acb3-a6afe7f66329 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:34.645607 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5e3b71c1-4def-4bfe-acb3-a6afe7f66329 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:34.647843 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5e3b71c1-4def-4bfe-acb3-a6afe7f66329 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1280 microversion: 2.20 time: 0.118927 Jul 07 10:31:34.648898 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 297/616] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:31:34 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1280 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:31:35.668086 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-dfbe7bb2-7144-4d7f-aef4-024a03150e31 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:35.668779 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-dfbe7bb2-7144-4d7f-aef4-024a03150e31 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:35.675913 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-dfbe7bb2-7144-4d7f-aef4-024a03150e31 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:35.676702 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-dfbe7bb2-7144-4d7f-aef4-024a03150e31 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:35.677892 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-dfbe7bb2-7144-4d7f-aef4-024a03150e31 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:35.678572 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-dfbe7bb2-7144-4d7f-aef4-024a03150e31 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:35.752739 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-dfbe7bb2-7144-4d7f-aef4-024a03150e31 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:35.768338 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-dfbe7bb2-7144-4d7f-aef4-024a03150e31 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:35.770078 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-dfbe7bb2-7144-4d7f-aef4-024a03150e31 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:35.771553 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-dfbe7bb2-7144-4d7f-aef4-024a03150e31 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1340 microversion: 2.20 time: 0.108713 Jul 07 10:31:35.773327 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 320/617] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:31:35 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1340 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:31:36.789633 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a36cd081-318c-49b8-946f-58d00bdaff34 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:36.790400 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a36cd081-318c-49b8-946f-58d00bdaff34 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:36.797125 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a36cd081-318c-49b8-946f-58d00bdaff34 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:36.797655 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a36cd081-318c-49b8-946f-58d00bdaff34 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:36.798437 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a36cd081-318c-49b8-946f-58d00bdaff34 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:36.798880 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a36cd081-318c-49b8-946f-58d00bdaff34 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:37.268153 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a36cd081-318c-49b8-946f-58d00bdaff34 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:37.276336 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a36cd081-318c-49b8-946f-58d00bdaff34 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:37.278140 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a36cd081-318c-49b8-946f-58d00bdaff34 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:37.279273 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a36cd081-318c-49b8-946f-58d00bdaff34 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1406 microversion: 2.20 time: 0.493582 Jul 07 10:31:37.289877 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 298/618] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:31:36 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1406 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:31:37.411994 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-6d4dbb35-0cc0-47b9-ab0b-3177883a0362 req-c03a3505-8b37-4a35-a330-5302290107e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b52e1947-1b4e-4a83-9041-ea3b84be027f", "tag": "ec13cec0-c49a-4b4e-b223-9bc0ab7b4152"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:31:37.423705 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-6d4dbb35-0cc0-47b9-ab0b-3177883a0362 req-c03a3505-8b37-4a35-a330-5302290107e3 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:37.424517 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-6d4dbb35-0cc0-47b9-ab0b-3177883a0362 req-c03a3505-8b37-4a35-a330-5302290107e3 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:37.440731 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-6d4dbb35-0cc0-47b9-ab0b-3177883a0362 req-c03a3505-8b37-4a35-a330-5302290107e3 service nova] Creating event network-changed:ec13cec0-c49a-4b4e-b223-9bc0ab7b4152 for instance b52e1947-1b4e-4a83-9041-ea3b84be027f on hv-cinder-82282 Jul 07 10:31:37.447911 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-6d4dbb35-0cc0-47b9-ab0b-3177883a0362 req-c03a3505-8b37-4a35-a330-5302290107e3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041792 Jul 07 10:31:37.448831 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 321/619] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:31:38.297421 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-bc3da581-9e42-451f-ae37-241cd4f51fb3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:38.297960 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-bc3da581-9e42-451f-ae37-241cd4f51fb3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:38.304522 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bc3da581-9e42-451f-ae37-241cd4f51fb3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:38.304976 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bc3da581-9e42-451f-ae37-241cd4f51fb3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:38.305734 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bc3da581-9e42-451f-ae37-241cd4f51fb3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:38.306172 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bc3da581-9e42-451f-ae37-241cd4f51fb3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:38.432531 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-bc3da581-9e42-451f-ae37-241cd4f51fb3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:38.440253 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-bc3da581-9e42-451f-ae37-241cd4f51fb3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:38.441805 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-bc3da581-9e42-451f-ae37-241cd4f51fb3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:38.442945 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-bc3da581-9e42-451f-ae37-241cd4f51fb3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1406 microversion: 2.20 time: 0.149500 Jul 07 10:31:38.443501 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 299/620] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:31:38 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:31:39.462487 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-938d1c27-15c0-4430-b19b-7044b8c3fffa tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:39.463086 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-938d1c27-15c0-4430-b19b-7044b8c3fffa tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:39.469401 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-938d1c27-15c0-4430-b19b-7044b8c3fffa tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:39.469843 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-938d1c27-15c0-4430-b19b-7044b8c3fffa tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:39.470595 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-938d1c27-15c0-4430-b19b-7044b8c3fffa tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:39.471026 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-938d1c27-15c0-4430-b19b-7044b8c3fffa tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:39.597097 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-938d1c27-15c0-4430-b19b-7044b8c3fffa tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:39.605376 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-938d1c27-15c0-4430-b19b-7044b8c3fffa tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:39.606864 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-938d1c27-15c0-4430-b19b-7044b8c3fffa tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:39.607987 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-938d1c27-15c0-4430-b19b-7044b8c3fffa tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1406 microversion: 2.20 time: 0.150840 Jul 07 10:31:39.608533 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 322/621] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:31:39 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:31:40.626294 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-f095874c-5820-490c-807d-a7ede02beb8a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:40.627062 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-f095874c-5820-490c-807d-a7ede02beb8a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:40.633392 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f095874c-5820-490c-807d-a7ede02beb8a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:40.633840 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f095874c-5820-490c-807d-a7ede02beb8a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:40.634598 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f095874c-5820-490c-807d-a7ede02beb8a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:40.635030 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f095874c-5820-490c-807d-a7ede02beb8a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:40.761540 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f095874c-5820-490c-807d-a7ede02beb8a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:40.769313 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f095874c-5820-490c-807d-a7ede02beb8a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:40.770813 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f095874c-5820-490c-807d-a7ede02beb8a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:40.772434 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-f095874c-5820-490c-807d-a7ede02beb8a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1406 microversion: 2.20 time: 0.149615 Jul 07 10:31:40.772992 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 300/622] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:31:40 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:31:41.790556 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-d4be7a0c-e0bc-4a26-a38d-86386a5dfa4b tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:41.791096 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-d4be7a0c-e0bc-4a26-a38d-86386a5dfa4b tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:41.797554 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d4be7a0c-e0bc-4a26-a38d-86386a5dfa4b tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:41.798011 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d4be7a0c-e0bc-4a26-a38d-86386a5dfa4b tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:41.798779 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d4be7a0c-e0bc-4a26-a38d-86386a5dfa4b tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:41.799220 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d4be7a0c-e0bc-4a26-a38d-86386a5dfa4b tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:41.929530 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-d4be7a0c-e0bc-4a26-a38d-86386a5dfa4b tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:41.937413 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-d4be7a0c-e0bc-4a26-a38d-86386a5dfa4b tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:41.938920 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-d4be7a0c-e0bc-4a26-a38d-86386a5dfa4b tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:41.940096 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-d4be7a0c-e0bc-4a26-a38d-86386a5dfa4b tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1406 microversion: 2.20 time: 0.153993 Jul 07 10:31:41.940647 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 323/623] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:31:41 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:31:42.329487 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-fdcfa8a9-c3c9-417d-a895-765249f5e03b req-e0a67255-f26f-48e1-9d44-fd1e4cc2ad51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b52e1947-1b4e-4a83-9041-ea3b84be027f", "name": "network-vif-plugged", "status": "completed", "tag": "ec13cec0-c49a-4b4e-b223-9bc0ab7b4152"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:31:42.338350 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-fdcfa8a9-c3c9-417d-a895-765249f5e03b req-e0a67255-f26f-48e1-9d44-fd1e4cc2ad51 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:42.338801 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-fdcfa8a9-c3c9-417d-a895-765249f5e03b req-e0a67255-f26f-48e1-9d44-fd1e4cc2ad51 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:42.349436 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-fdcfa8a9-c3c9-417d-a895-765249f5e03b req-e0a67255-f26f-48e1-9d44-fd1e4cc2ad51 service nova] Creating event network-vif-plugged:ec13cec0-c49a-4b4e-b223-9bc0ab7b4152 for instance b52e1947-1b4e-4a83-9041-ea3b84be027f on hv-cinder-82282 Jul 07 10:31:42.354875 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-fdcfa8a9-c3c9-417d-a895-765249f5e03b req-e0a67255-f26f-48e1-9d44-fd1e4cc2ad51 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087335 Jul 07 10:31:42.355454 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 301/624] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:31:42.957801 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-687bbeb3-9233-47b5-a403-a1c1a2e50e22 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:42.958404 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-687bbeb3-9233-47b5-a403-a1c1a2e50e22 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:42.964854 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-687bbeb3-9233-47b5-a403-a1c1a2e50e22 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:42.965302 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-687bbeb3-9233-47b5-a403-a1c1a2e50e22 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:42.966061 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-687bbeb3-9233-47b5-a403-a1c1a2e50e22 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:42.966498 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-687bbeb3-9233-47b5-a403-a1c1a2e50e22 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:43.091994 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-687bbeb3-9233-47b5-a403-a1c1a2e50e22 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:43.099801 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-687bbeb3-9233-47b5-a403-a1c1a2e50e22 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:43.101306 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-687bbeb3-9233-47b5-a403-a1c1a2e50e22 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:43.102408 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-687bbeb3-9233-47b5-a403-a1c1a2e50e22 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1406 microversion: 2.20 time: 0.148516 Jul 07 10:31:43.102968 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 324/625] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:31:42 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:31:43.856311 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-dbbb9046-26a6-4159-a49e-bc688435d8f9 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:31:43.856974 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-dbbb9046-26a6-4159-a49e-bc688435d8f9 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:43.863159 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dbbb9046-26a6-4159-a49e-bc688435d8f9 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:43.863616 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dbbb9046-26a6-4159-a49e-bc688435d8f9 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:43.864414 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dbbb9046-26a6-4159-a49e-bc688435d8f9 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:43.864851 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dbbb9046-26a6-4159-a49e-bc688435d8f9 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:43.888243 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.objects.instance [None req-dbbb9046-26a6-4159-a49e-bc688435d8f9 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lazy-loading 'flavor' on Instance uuid 5f3963fd-1a48-4f86-a15e-c4fbcadc5911 {{(pid=117647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 10:31:43.957645 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-dbbb9046-26a6-4159-a49e-bc688435d8f9 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "POST /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911/action" status: 202 len: 0 microversion: 2.1 time: 0.106042 Jul 07 10:31:43.958237 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 302/626] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Jul 7 10:31:43 2022] POST /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 10:31:43.966696 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-6d1dc9a8-edd4-4083-b94d-6b0eae5d9cba tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:43.967306 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-6d1dc9a8-edd4-4083-b94d-6b0eae5d9cba tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:43.973782 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6d1dc9a8-edd4-4083-b94d-6b0eae5d9cba tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:43.974232 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6d1dc9a8-edd4-4083-b94d-6b0eae5d9cba tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:43.974993 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6d1dc9a8-edd4-4083-b94d-6b0eae5d9cba tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:43.975430 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6d1dc9a8-edd4-4083-b94d-6b0eae5d9cba tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:44.113907 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-6d1dc9a8-edd4-4083-b94d-6b0eae5d9cba tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:44.121212 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9bc43f37-b3db-47db-a5e0-8934c3d76f53 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:44.122039 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-9bc43f37-b3db-47db-a5e0-8934c3d76f53 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:44.122314 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-6d1dc9a8-edd4-4083-b94d-6b0eae5d9cba tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1565 microversion: 2.1 time: 0.159429 Jul 07 10:31:44.123205 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 325/627] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:43 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:44.128167 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9bc43f37-b3db-47db-a5e0-8934c3d76f53 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:44.128618 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9bc43f37-b3db-47db-a5e0-8934c3d76f53 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:44.129432 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9bc43f37-b3db-47db-a5e0-8934c3d76f53 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:44.129867 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9bc43f37-b3db-47db-a5e0-8934c3d76f53 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:44.256988 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9bc43f37-b3db-47db-a5e0-8934c3d76f53 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:44.264743 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9bc43f37-b3db-47db-a5e0-8934c3d76f53 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:44.266380 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9bc43f37-b3db-47db-a5e0-8934c3d76f53 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:44.267520 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9bc43f37-b3db-47db-a5e0-8934c3d76f53 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1598 microversion: 2.20 time: 0.150615 Jul 07 10:31:44.268101 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 303/628] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:31:44 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 10:31:44.284395 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-32d2c2a4-4e5c-4f2a-85cf-d2d7299ed53a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:44.284891 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-32d2c2a4-4e5c-4f2a-85cf-d2d7299ed53a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:44.291292 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-32d2c2a4-4e5c-4f2a-85cf-d2d7299ed53a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:44.291762 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-32d2c2a4-4e5c-4f2a-85cf-d2d7299ed53a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:44.292533 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-32d2c2a4-4e5c-4f2a-85cf-d2d7299ed53a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:44.292998 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-32d2c2a4-4e5c-4f2a-85cf-d2d7299ed53a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:44.368827 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-32d2c2a4-4e5c-4f2a-85cf-d2d7299ed53a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.088217 Jul 07 10:31:44.369433 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 326/629] 10.222.0.16 () {60 vars in 1315 bytes} [Thu Jul 7 10:31:44 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 10:31:45.139959 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-be014a53-3497-4eba-a826-f3c8767b01c3 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:45.140579 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-be014a53-3497-4eba-a826-f3c8767b01c3 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:45.142554 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=6 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:31:45.148750 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-be014a53-3497-4eba-a826-f3c8767b01c3 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:45.149209 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-be014a53-3497-4eba-a826-f3c8767b01c3 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:45.149979 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-be014a53-3497-4eba-a826-f3c8767b01c3 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:45.150419 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-be014a53-3497-4eba-a826-f3c8767b01c3 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:45.266344 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell0:SELECT=2 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:31:45.267854 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell0:SELECT=6 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:31:45.301473 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-be014a53-3497-4eba-a826-f3c8767b01c3 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:45.309929 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-be014a53-3497-4eba-a826-f3c8767b01c3 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1565 microversion: 2.1 time: 0.173942 Jul 07 10:31:45.310724 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 304/630] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:45 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:45.338389 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-c783fd27-0f47-4a6d-9d3f-5f14f3249797 req-cc0fc9b8-1dc1-4030-8ce0-fe6f85ab6eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b52e1947-1b4e-4a83-9041-ea3b84be027f", "tag": "ec13cec0-c49a-4b4e-b223-9bc0ab7b4152"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:31:45.346473 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-c783fd27-0f47-4a6d-9d3f-5f14f3249797 req-cc0fc9b8-1dc1-4030-8ce0-fe6f85ab6eb0 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:45.346924 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-c783fd27-0f47-4a6d-9d3f-5f14f3249797 req-cc0fc9b8-1dc1-4030-8ce0-fe6f85ab6eb0 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:45.357920 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-c783fd27-0f47-4a6d-9d3f-5f14f3249797 req-cc0fc9b8-1dc1-4030-8ce0-fe6f85ab6eb0 service nova] Creating event network-changed:ec13cec0-c49a-4b4e-b223-9bc0ab7b4152 for instance b52e1947-1b4e-4a83-9041-ea3b84be027f on hv-cinder-82282 Jul 07 10:31:45.363007 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-c783fd27-0f47-4a6d-9d3f-5f14f3249797 req-cc0fc9b8-1dc1-4030-8ce0-fe6f85ab6eb0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097366 Jul 07 10:31:45.363607 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 327/631] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:31:46.327800 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a623d9c9-526b-4c82-9e04-f4d50cc6fdd0 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:46.328417 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a623d9c9-526b-4c82-9e04-f4d50cc6fdd0 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:46.335328 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a623d9c9-526b-4c82-9e04-f4d50cc6fdd0 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:46.335890 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a623d9c9-526b-4c82-9e04-f4d50cc6fdd0 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:46.336656 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a623d9c9-526b-4c82-9e04-f4d50cc6fdd0 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:46.337098 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a623d9c9-526b-4c82-9e04-f4d50cc6fdd0 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:46.464519 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a623d9c9-526b-4c82-9e04-f4d50cc6fdd0 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:46.472095 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a623d9c9-526b-4c82-9e04-f4d50cc6fdd0 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1565 microversion: 2.1 time: 0.148235 Jul 07 10:31:46.472661 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 305/632] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:46 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:47.489687 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-2396a92e-f50e-4ca1-b205-361499610557 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:47.490819 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-2396a92e-f50e-4ca1-b205-361499610557 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:47.496938 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2396a92e-f50e-4ca1-b205-361499610557 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:47.497386 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2396a92e-f50e-4ca1-b205-361499610557 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:47.498137 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2396a92e-f50e-4ca1-b205-361499610557 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:47.498568 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2396a92e-f50e-4ca1-b205-361499610557 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:47.633075 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-2396a92e-f50e-4ca1-b205-361499610557 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:47.640587 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-2396a92e-f50e-4ca1-b205-361499610557 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1565 microversion: 2.1 time: 0.155647 Jul 07 10:31:47.641155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 328/633] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:47 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:48.657821 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1d3599ce-732c-43ed-9e2d-4f80154d121b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:48.658428 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1d3599ce-732c-43ed-9e2d-4f80154d121b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:48.665368 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1d3599ce-732c-43ed-9e2d-4f80154d121b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:48.665813 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1d3599ce-732c-43ed-9e2d-4f80154d121b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:48.666555 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1d3599ce-732c-43ed-9e2d-4f80154d121b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:48.666993 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1d3599ce-732c-43ed-9e2d-4f80154d121b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:48.793536 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-1d3599ce-732c-43ed-9e2d-4f80154d121b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:48.800948 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1d3599ce-732c-43ed-9e2d-4f80154d121b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1565 microversion: 2.1 time: 0.147008 Jul 07 10:31:48.801510 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 306/634] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:48 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:49.062601 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-d0bd7702-8624-47ff-82e5-4aa74b19f592 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:49.063093 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-d0bd7702-8624-47ff-82e5-4aa74b19f592 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:49.069760 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d0bd7702-8624-47ff-82e5-4aa74b19f592 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:49.070207 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d0bd7702-8624-47ff-82e5-4aa74b19f592 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:49.070959 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d0bd7702-8624-47ff-82e5-4aa74b19f592 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:49.071394 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d0bd7702-8624-47ff-82e5-4aa74b19f592 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:49.094034 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-d0bd7702-8624-47ff-82e5-4aa74b19f592 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba/ips" status: 200 len: 145 microversion: 2.1 time: 0.035336 Jul 07 10:31:49.094572 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 329/635] 10.222.0.16 () {58 vars in 1247 bytes} [Thu Jul 7 10:31:49 2022] GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:31:49.819168 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-17f2628b-b636-4212-a3ee-2a2d623b54c7 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:49.819793 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-17f2628b-b636-4212-a3ee-2a2d623b54c7 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:49.822042 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:31:49.827084 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-17f2628b-b636-4212-a3ee-2a2d623b54c7 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:49.827524 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-17f2628b-b636-4212-a3ee-2a2d623b54c7 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:49.828304 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-17f2628b-b636-4212-a3ee-2a2d623b54c7 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:49.828731 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-17f2628b-b636-4212-a3ee-2a2d623b54c7 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:49.963333 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-17f2628b-b636-4212-a3ee-2a2d623b54c7 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:49.970822 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-17f2628b-b636-4212-a3ee-2a2d623b54c7 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1565 microversion: 2.1 time: 0.156422 Jul 07 10:31:49.971386 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 307/636] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:49 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:50.402015 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-ff468241-6bdd-46cf-a359-c57c03e25ba3 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f867373-6b5f-46fc-b257-2f73295d5db0"}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:31:50.403110 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-ff468241-6bdd-46cf-a359-c57c03e25ba3 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:50.405524 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:31:50.411013 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ff468241-6bdd-46cf-a359-c57c03e25ba3 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:50.411468 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ff468241-6bdd-46cf-a359-c57c03e25ba3 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:50.412847 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ff468241-6bdd-46cf-a359-c57c03e25ba3 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:50.413287 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ff468241-6bdd-46cf-a359-c57c03e25ba3 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:50.644162 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-ff468241-6bdd-46cf-a359-c57c03e25ba3 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "POST /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.245982 Jul 07 10:31:50.644957 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 330/637] 10.222.0.16 () {60 vars in 1322 bytes} [Thu Jul 7 10:31:50 2022] POST /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba/os-volume_attachments => generated 194 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:31:50.988194 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-79408c27-3bfa-477d-b210-f96d2d64109a tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:50.988796 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-79408c27-3bfa-477d-b210-f96d2d64109a tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:50.995657 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-79408c27-3bfa-477d-b210-f96d2d64109a tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:50.996136 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-79408c27-3bfa-477d-b210-f96d2d64109a tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:50.996887 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-79408c27-3bfa-477d-b210-f96d2d64109a tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:50.997312 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-79408c27-3bfa-477d-b210-f96d2d64109a tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:51.133729 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-79408c27-3bfa-477d-b210-f96d2d64109a tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:51.141279 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-79408c27-3bfa-477d-b210-f96d2d64109a tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1565 microversion: 2.1 time: 0.157443 Jul 07 10:31:51.141836 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 308/638] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:50 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:52.160064 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-76732325-c284-4827-8818-a5d778ee1a3b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:52.161317 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-76732325-c284-4827-8818-a5d778ee1a3b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:52.168893 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-76732325-c284-4827-8818-a5d778ee1a3b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:52.169343 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-76732325-c284-4827-8818-a5d778ee1a3b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:52.170117 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-76732325-c284-4827-8818-a5d778ee1a3b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:52.170552 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-76732325-c284-4827-8818-a5d778ee1a3b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:52.297657 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-76732325-c284-4827-8818-a5d778ee1a3b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:52.305188 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-76732325-c284-4827-8818-a5d778ee1a3b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1565 microversion: 2.1 time: 0.150469 Jul 07 10:31:52.305743 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 331/639] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:52 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:53.322579 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0afceb2f-1fe5-4250-92c9-d866531f3173 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:53.323192 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0afceb2f-1fe5-4250-92c9-d866531f3173 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:53.329722 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0afceb2f-1fe5-4250-92c9-d866531f3173 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:53.330181 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0afceb2f-1fe5-4250-92c9-d866531f3173 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:53.330943 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0afceb2f-1fe5-4250-92c9-d866531f3173 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:53.331387 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0afceb2f-1fe5-4250-92c9-d866531f3173 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:53.463764 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0afceb2f-1fe5-4250-92c9-d866531f3173 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:53.471282 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0afceb2f-1fe5-4250-92c9-d866531f3173 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1565 microversion: 2.1 time: 0.152883 Jul 07 10:31:53.471886 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 309/640] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:53 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:54.488991 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-5e6b2023-7c7e-46d6-a202-bf930577cd09 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:54.489709 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-5e6b2023-7c7e-46d6-a202-bf930577cd09 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:54.496824 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5e6b2023-7c7e-46d6-a202-bf930577cd09 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:54.497279 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5e6b2023-7c7e-46d6-a202-bf930577cd09 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:54.498051 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5e6b2023-7c7e-46d6-a202-bf930577cd09 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:54.498490 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5e6b2023-7c7e-46d6-a202-bf930577cd09 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:54.857066 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-5e6b2023-7c7e-46d6-a202-bf930577cd09 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:54.864617 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-5e6b2023-7c7e-46d6-a202-bf930577cd09 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1565 microversion: 2.1 time: 0.379482 Jul 07 10:31:54.865757 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 332/641] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:54 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1565 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:55.882262 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-bc7ea920-1ff3-4d1b-ab6c-81b9a48018d7 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:55.882869 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-bc7ea920-1ff3-4d1b-ab6c-81b9a48018d7 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:55.889504 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bc7ea920-1ff3-4d1b-ab6c-81b9a48018d7 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:55.889956 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bc7ea920-1ff3-4d1b-ab6c-81b9a48018d7 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:55.890715 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bc7ea920-1ff3-4d1b-ab6c-81b9a48018d7 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:55.891151 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bc7ea920-1ff3-4d1b-ab6c-81b9a48018d7 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:56.022620 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-bc7ea920-1ff3-4d1b-ab6c-81b9a48018d7 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:56.030125 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-bc7ea920-1ff3-4d1b-ab6c-81b9a48018d7 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1565 microversion: 2.1 time: 0.151743 Jul 07 10:31:56.030680 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 310/642] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:55 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:57.047560 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-4fcd41d9-410c-4b7a-a1d5-692b1b267a0b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:57.048125 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-4fcd41d9-410c-4b7a-a1d5-692b1b267a0b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:57.054579 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4fcd41d9-410c-4b7a-a1d5-692b1b267a0b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:57.055025 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4fcd41d9-410c-4b7a-a1d5-692b1b267a0b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:57.055795 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4fcd41d9-410c-4b7a-a1d5-692b1b267a0b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:57.056229 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4fcd41d9-410c-4b7a-a1d5-692b1b267a0b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:57.196580 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-4fcd41d9-410c-4b7a-a1d5-692b1b267a0b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:57.204227 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-4fcd41d9-410c-4b7a-a1d5-692b1b267a0b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1565 microversion: 2.1 time: 0.160437 Jul 07 10:31:57.204800 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 333/643] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:57 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:31:58.119904 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-15dd8010-a5ee-4f29-adec-3a75d619df35 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:58.120879 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-15dd8010-a5ee-4f29-adec-3a75d619df35 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:58.127179 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-15dd8010-a5ee-4f29-adec-3a75d619df35 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:58.127622 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-15dd8010-a5ee-4f29-adec-3a75d619df35 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:58.128404 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-15dd8010-a5ee-4f29-adec-3a75d619df35 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:58.128833 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-15dd8010-a5ee-4f29-adec-3a75d619df35 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:58.157082 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-15dd8010-a5ee-4f29-adec-3a75d619df35 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041585 Jul 07 10:31:58.157618 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 311/644] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jul 7 10:31:58 2022] GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:31:58.167192 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-2fed2dda-28cd-4da1-ae0b-9ceacc39a9aa tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:58.167689 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-2fed2dda-28cd-4da1-ae0b-9ceacc39a9aa tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:58.174119 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2fed2dda-28cd-4da1-ae0b-9ceacc39a9aa tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:58.174568 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2fed2dda-28cd-4da1-ae0b-9ceacc39a9aa tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:58.175327 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2fed2dda-28cd-4da1-ae0b-9ceacc39a9aa tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:58.175784 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2fed2dda-28cd-4da1-ae0b-9ceacc39a9aa tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:58.205341 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-2fed2dda-28cd-4da1-ae0b-9ceacc39a9aa tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba/os-volume_attachments/5f867373-6b5f-46fc-b257-2f73295d5db0" status: 200 len: 194 microversion: 2.1 time: 0.042061 Jul 07 10:31:58.205902 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 334/645] 10.222.0.16 () {58 vars in 1412 bytes} [Thu Jul 7 10:31:58 2022] GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba/os-volume_attachments/5f867373-6b5f-46fc-b257-2f73295d5db0 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:31:58.220674 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d468a9ec-2275-4944-aac3-e11a1d89f0fd tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:58.221278 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d468a9ec-2275-4944-aac3-e11a1d89f0fd tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:58.227274 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d468a9ec-2275-4944-aac3-e11a1d89f0fd tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:58.227818 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d468a9ec-2275-4944-aac3-e11a1d89f0fd tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:58.228576 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d468a9ec-2275-4944-aac3-e11a1d89f0fd tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:58.229009 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d468a9ec-2275-4944-aac3-e11a1d89f0fd tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:58.362218 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d468a9ec-2275-4944-aac3-e11a1d89f0fd tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:58.370316 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d468a9ec-2275-4944-aac3-e11a1d89f0fd tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1506 microversion: 2.1 time: 0.153372 Jul 07 10:31:58.370889 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 312/646] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:58 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:58.387111 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-db4a5a66-b514-4c5d-8343-474d5026aa0e tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:31:58.387611 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-db4a5a66-b514-4c5d-8343-474d5026aa0e tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:58.394221 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-db4a5a66-b514-4c5d-8343-474d5026aa0e tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:58.394682 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-db4a5a66-b514-4c5d-8343-474d5026aa0e tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:58.395532 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-db4a5a66-b514-4c5d-8343-474d5026aa0e tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:58.396195 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-db4a5a66-b514-4c5d-8343-474d5026aa0e tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:58.481285 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:31:58.496983 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-db4a5a66-b514-4c5d-8343-474d5026aa0e tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "POST /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911/action" status: 202 len: 0 microversion: 2.1 time: 0.113894 Jul 07 10:31:58.497867 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 335/647] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Jul 7 10:31:58 2022] POST /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 10:31:58.505917 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-f528fa17-a890-4069-be92-ac3a109cab08 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:58.506612 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-f528fa17-a890-4069-be92-ac3a109cab08 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:58.512806 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f528fa17-a890-4069-be92-ac3a109cab08 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:58.513249 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f528fa17-a890-4069-be92-ac3a109cab08 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:58.514098 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f528fa17-a890-4069-be92-ac3a109cab08 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:58.514573 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f528fa17-a890-4069-be92-ac3a109cab08 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:58.518792 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:31:58.657877 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f528fa17-a890-4069-be92-ac3a109cab08 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:58.666160 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-f528fa17-a890-4069-be92-ac3a109cab08 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1514 microversion: 2.1 time: 0.164249 Jul 07 10:31:58.666740 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 313/648] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:58 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:31:59.527942 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-fcbdba3e-6fe7-49ee-9560-88520397626f tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c65cac0a-2302-48c3-903d-f331e0ca109c"}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:31:59.529054 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-fcbdba3e-6fe7-49ee-9560-88520397626f tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:59.536147 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fcbdba3e-6fe7-49ee-9560-88520397626f tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:59.536712 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fcbdba3e-6fe7-49ee-9560-88520397626f tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:59.538205 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fcbdba3e-6fe7-49ee-9560-88520397626f tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:59.538771 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fcbdba3e-6fe7-49ee-9560-88520397626f tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:59.682580 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-493324ed-0371-420e-a8e9-d48edad9b865 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:31:59.683208 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-493324ed-0371-420e-a8e9-d48edad9b865 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:31:59.693104 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-493324ed-0371-420e-a8e9-d48edad9b865 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:59.694025 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-493324ed-0371-420e-a8e9-d48edad9b865 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:59.694989 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-493324ed-0371-420e-a8e9-d48edad9b865 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:31:59.695429 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-493324ed-0371-420e-a8e9-d48edad9b865 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:31:59.798966 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-fcbdba3e-6fe7-49ee-9560-88520397626f tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "POST /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275231 Jul 07 10:31:59.799968 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 336/649] 10.222.0.16 () {60 vars in 1322 bytes} [Thu Jul 7 10:31:59 2022] POST /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:31:59.846218 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-493324ed-0371-420e-a8e9-d48edad9b865 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:31:59.855248 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-493324ed-0371-420e-a8e9-d48edad9b865 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1516 microversion: 2.1 time: 0.176481 Jul 07 10:31:59.865601 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 314/650] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:31:59 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1516 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:32:00.374231 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-a9314c82-09f1-48e4-ae29-3c4c463df43b req-0ee81062-68a6-420e-9910-98082ae56c8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3963fd-1a48-4f86-a15e-c4fbcadc5911", "name": "network-vif-unplugged", "status": "completed", "tag": "52658524-0e22-481a-99ab-eb339029366f"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:32:00.384200 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-a9314c82-09f1-48e4-ae29-3c4c463df43b req-0ee81062-68a6-420e-9910-98082ae56c8f service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:00.384653 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-a9314c82-09f1-48e4-ae29-3c4c463df43b req-0ee81062-68a6-420e-9910-98082ae56c8f service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:00.396635 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-a9314c82-09f1-48e4-ae29-3c4c463df43b req-0ee81062-68a6-420e-9910-98082ae56c8f service nova] Creating event network-vif-unplugged:52658524-0e22-481a-99ab-eb339029366f for instance 5f3963fd-1a48-4f86-a15e-c4fbcadc5911 on hv-cinder-82282 Jul 07 10:32:00.401463 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-a9314c82-09f1-48e4-ae29-3c4c463df43b req-0ee81062-68a6-420e-9910-98082ae56c8f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032115 Jul 07 10:32:00.402287 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 337/651] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:32:00.872995 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e33f345f-afdc-4012-965a-1fc894bc41d4 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:00.873613 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e33f345f-afdc-4012-965a-1fc894bc41d4 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:00.880077 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e33f345f-afdc-4012-965a-1fc894bc41d4 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:00.880540 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e33f345f-afdc-4012-965a-1fc894bc41d4 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:00.881864 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e33f345f-afdc-4012-965a-1fc894bc41d4 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:00.882310 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e33f345f-afdc-4012-965a-1fc894bc41d4 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:01.013242 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e33f345f-afdc-4012-965a-1fc894bc41d4 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:01.020780 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e33f345f-afdc-4012-965a-1fc894bc41d4 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1572 microversion: 2.1 time: 0.151624 Jul 07 10:32:01.021350 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 315/652] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:00 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1572 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:02.039988 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-4227f0e6-1182-48dd-8901-ef9abc4291cd tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:02.040685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-4227f0e6-1182-48dd-8901-ef9abc4291cd tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:02.046863 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4227f0e6-1182-48dd-8901-ef9abc4291cd tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:02.047314 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4227f0e6-1182-48dd-8901-ef9abc4291cd tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:02.048098 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4227f0e6-1182-48dd-8901-ef9abc4291cd tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:02.048538 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4227f0e6-1182-48dd-8901-ef9abc4291cd tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:02.184988 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-4227f0e6-1182-48dd-8901-ef9abc4291cd tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:02.192476 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-4227f0e6-1182-48dd-8901-ef9abc4291cd tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1572 microversion: 2.1 time: 0.157828 Jul 07 10:32:02.193035 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 338/653] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:02 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1572 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:03.210240 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-891d4c5a-d197-4352-955a-59a27fed6951 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:03.210850 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-891d4c5a-d197-4352-955a-59a27fed6951 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:03.217336 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-891d4c5a-d197-4352-955a-59a27fed6951 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:03.217733 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-891d4c5a-d197-4352-955a-59a27fed6951 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:03.218492 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-891d4c5a-d197-4352-955a-59a27fed6951 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:03.218946 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-891d4c5a-d197-4352-955a-59a27fed6951 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:03.346151 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-891d4c5a-d197-4352-955a-59a27fed6951 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:03.353696 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-891d4c5a-d197-4352-955a-59a27fed6951 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1572 microversion: 2.1 time: 0.147910 Jul 07 10:32:03.354268 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 316/654] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:03 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1572 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:04.370350 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-88466122-4210-487c-b539-c02a5bd75adf tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:04.370937 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-88466122-4210-487c-b539-c02a5bd75adf tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:04.377411 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-88466122-4210-487c-b539-c02a5bd75adf tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:04.377853 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-88466122-4210-487c-b539-c02a5bd75adf tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:04.378603 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-88466122-4210-487c-b539-c02a5bd75adf tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:04.379036 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-88466122-4210-487c-b539-c02a5bd75adf tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:04.504048 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-88466122-4210-487c-b539-c02a5bd75adf tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:04.511532 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-88466122-4210-487c-b539-c02a5bd75adf tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1572 microversion: 2.1 time: 0.145005 Jul 07 10:32:04.512203 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 339/655] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:04 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1572 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:05.528744 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b8c4cb3a-d791-4f91-ba75-d91f548addc6 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:05.529358 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b8c4cb3a-d791-4f91-ba75-d91f548addc6 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:05.535914 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b8c4cb3a-d791-4f91-ba75-d91f548addc6 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:05.536365 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b8c4cb3a-d791-4f91-ba75-d91f548addc6 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:05.537630 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b8c4cb3a-d791-4f91-ba75-d91f548addc6 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:05.538068 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b8c4cb3a-d791-4f91-ba75-d91f548addc6 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:05.678999 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b8c4cb3a-d791-4f91-ba75-d91f548addc6 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:05.686398 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b8c4cb3a-d791-4f91-ba75-d91f548addc6 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1572 microversion: 2.1 time: 0.161529 Jul 07 10:32:05.686964 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 317/656] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:05 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1572 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:06.703571 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-56e75883-4f49-4e37-817c-10927cc06af2 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:06.704210 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-56e75883-4f49-4e37-817c-10927cc06af2 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:06.710643 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-56e75883-4f49-4e37-817c-10927cc06af2 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:06.711102 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-56e75883-4f49-4e37-817c-10927cc06af2 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:06.711890 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-56e75883-4f49-4e37-817c-10927cc06af2 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:06.712332 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-56e75883-4f49-4e37-817c-10927cc06af2 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:06.843128 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-56e75883-4f49-4e37-817c-10927cc06af2 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:06.850628 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-56e75883-4f49-4e37-817c-10927cc06af2 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1572 microversion: 2.1 time: 0.150889 Jul 07 10:32:06.851196 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 340/657] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:06 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1572 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:07.867676 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a41f1a68-5892-453c-810b-1f51feee48b4 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:07.868318 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a41f1a68-5892-453c-810b-1f51feee48b4 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:07.874982 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a41f1a68-5892-453c-810b-1f51feee48b4 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:07.875428 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a41f1a68-5892-453c-810b-1f51feee48b4 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:07.876222 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a41f1a68-5892-453c-810b-1f51feee48b4 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:07.876676 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a41f1a68-5892-453c-810b-1f51feee48b4 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:08.006295 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a41f1a68-5892-453c-810b-1f51feee48b4 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:08.014050 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a41f1a68-5892-453c-810b-1f51feee48b4 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1572 microversion: 2.1 time: 0.150291 Jul 07 10:32:08.014674 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 318/658] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:07 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1572 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:08.334985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-e53bc39c-b0a6-46a9-8178-672568fad9ae tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:08.336089 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-e53bc39c-b0a6-46a9-8178-672568fad9ae tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:08.342640 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e53bc39c-b0a6-46a9-8178-672568fad9ae tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:08.343101 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e53bc39c-b0a6-46a9-8178-672568fad9ae tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:08.343906 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e53bc39c-b0a6-46a9-8178-672568fad9ae tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:08.344352 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e53bc39c-b0a6-46a9-8178-672568fad9ae tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:08.373302 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-e53bc39c-b0a6-46a9-8178-672568fad9ae tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042605 Jul 07 10:32:08.373857 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 341/659] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jul 7 10:32:08 2022] GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:32:08.513685 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-cc609a46-d1ef-4487-8401-bdbf16a89f8f tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:08.514195 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-cc609a46-d1ef-4487-8401-bdbf16a89f8f tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:08.520579 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cc609a46-d1ef-4487-8401-bdbf16a89f8f tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:08.521027 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cc609a46-d1ef-4487-8401-bdbf16a89f8f tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:08.521890 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cc609a46-d1ef-4487-8401-bdbf16a89f8f tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:08.522328 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cc609a46-d1ef-4487-8401-bdbf16a89f8f tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:08.550826 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-cc609a46-d1ef-4487-8401-bdbf16a89f8f tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba/os-volume_attachments/5f867373-6b5f-46fc-b257-2f73295d5db0" status: 200 len: 194 microversion: 2.1 time: 0.041474 Jul 07 10:32:08.551386 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 319/660] 10.222.0.16 () {58 vars in 1412 bytes} [Thu Jul 7 10:32:08 2022] GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba/os-volume_attachments/5f867373-6b5f-46fc-b257-2f73295d5db0 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:32:08.561589 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-823f754c-849e-486a-a316-140c35c68f09 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:08.562102 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-823f754c-849e-486a-a316-140c35c68f09 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:08.567981 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-823f754c-849e-486a-a316-140c35c68f09 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:08.568691 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-823f754c-849e-486a-a316-140c35c68f09 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:08.569437 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-823f754c-849e-486a-a316-140c35c68f09 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:08.569870 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-823f754c-849e-486a-a316-140c35c68f09 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:08.648909 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.objects.instance [None req-823f754c-849e-486a-a316-140c35c68f09 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lazy-loading 'services' on Instance uuid 4c12068c-75fc-441d-872b-046be6efeeba {{(pid=117646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 10:32:08.718505 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-823f754c-849e-486a-a316-140c35c68f09 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba/os-volume_attachments/5f867373-6b5f-46fc-b257-2f73295d5db0" status: 202 len: 0 microversion: 2.1 time: 0.160693 Jul 07 10:32:08.719087 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 342/661] 10.222.0.16 () {58 vars in 1415 bytes} [Thu Jul 7 10:32:08 2022] DELETE /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba/os-volume_attachments/5f867373-6b5f-46fc-b257-2f73295d5db0 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 10:32:09.032277 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-3ecbc34d-d959-4207-b10c-bebc0bd04cdb tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:09.032887 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-3ecbc34d-d959-4207-b10c-bebc0bd04cdb tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:09.040134 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3ecbc34d-d959-4207-b10c-bebc0bd04cdb tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:09.040588 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3ecbc34d-d959-4207-b10c-bebc0bd04cdb tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:09.041348 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3ecbc34d-d959-4207-b10c-bebc0bd04cdb tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:09.041786 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3ecbc34d-d959-4207-b10c-bebc0bd04cdb tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:09.172886 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-3ecbc34d-d959-4207-b10c-bebc0bd04cdb tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:09.180276 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-3ecbc34d-d959-4207-b10c-bebc0bd04cdb tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1559 microversion: 2.1 time: 0.152110 Jul 07 10:32:09.180832 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 320/662] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:09 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:10.879115 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-4ce7736b-a5b8-4b83-8ad8-9be32d23d315 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:10.879855 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-4ce7736b-a5b8-4b83-8ad8-9be32d23d315 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:10.886500 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4ce7736b-a5b8-4b83-8ad8-9be32d23d315 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:10.886949 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4ce7736b-a5b8-4b83-8ad8-9be32d23d315 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:10.887706 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4ce7736b-a5b8-4b83-8ad8-9be32d23d315 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:10.888164 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4ce7736b-a5b8-4b83-8ad8-9be32d23d315 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:10.917033 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-4ce7736b-a5b8-4b83-8ad8-9be32d23d315 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba/os-volume_attachments/c65cac0a-2302-48c3-903d-f331e0ca109c" status: 200 len: 194 microversion: 2.1 time: 0.042617 Jul 07 10:32:10.917637 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 343/663] 10.222.0.16 () {58 vars in 1412 bytes} [Thu Jul 7 10:32:10 2022] GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba/os-volume_attachments/c65cac0a-2302-48c3-903d-f331e0ca109c => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:32:10.927780 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-148c9f91-db20-4235-83b0-49cb1178f281 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:10.928376 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-148c9f91-db20-4235-83b0-49cb1178f281 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:10.934762 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-148c9f91-db20-4235-83b0-49cb1178f281 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:10.935282 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-148c9f91-db20-4235-83b0-49cb1178f281 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:10.936169 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-148c9f91-db20-4235-83b0-49cb1178f281 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:10.936601 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-148c9f91-db20-4235-83b0-49cb1178f281 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:11.017913 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.objects.instance [None req-148c9f91-db20-4235-83b0-49cb1178f281 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lazy-loading 'services' on Instance uuid 4c12068c-75fc-441d-872b-046be6efeeba {{(pid=117647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 10:32:11.087678 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-148c9f91-db20-4235-83b0-49cb1178f281 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba/os-volume_attachments/c65cac0a-2302-48c3-903d-f331e0ca109c" status: 202 len: 0 microversion: 2.1 time: 0.163654 Jul 07 10:32:11.088290 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 321/664] 10.222.0.16 () {58 vars in 1415 bytes} [Thu Jul 7 10:32:10 2022] DELETE /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba/os-volume_attachments/c65cac0a-2302-48c3-903d-f331e0ca109c => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 10:32:12.249986 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-1b1ea3ec-cd69-40dd-98bd-6c7bfee051db tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:12.250971 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-1b1ea3ec-cd69-40dd-98bd-6c7bfee051db tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:12.257478 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1b1ea3ec-cd69-40dd-98bd-6c7bfee051db tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:12.257932 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1b1ea3ec-cd69-40dd-98bd-6c7bfee051db tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:12.258694 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1b1ea3ec-cd69-40dd-98bd-6c7bfee051db tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:12.259136 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1b1ea3ec-cd69-40dd-98bd-6c7bfee051db tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:12.286617 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-1b1ea3ec-cd69-40dd-98bd-6c7bfee051db tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040585 Jul 07 10:32:12.287161 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 344/665] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jul 7 10:32:12 2022] GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 10:32:12.392017 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-69e3a828-2886-4860-a096-8cc6951bfb3d tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:12.393033 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-69e3a828-2886-4860-a096-8cc6951bfb3d tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:12.399306 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-69e3a828-2886-4860-a096-8cc6951bfb3d tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:12.399800 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-69e3a828-2886-4860-a096-8cc6951bfb3d tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:12.400644 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-69e3a828-2886-4860-a096-8cc6951bfb3d tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:12.401028 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-69e3a828-2886-4860-a096-8cc6951bfb3d tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:12.432355 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-69e3a828-2886-4860-a096-8cc6951bfb3d tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045018 Jul 07 10:32:12.432946 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 322/666] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jul 7 10:32:12 2022] GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 10:32:12.492844 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-bc230e26-4bea-4017-bcd4-2a9cfd791022 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:12.493466 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-bc230e26-4bea-4017-bcd4-2a9cfd791022 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:12.499685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bc230e26-4bea-4017-bcd4-2a9cfd791022 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:12.500248 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bc230e26-4bea-4017-bcd4-2a9cfd791022 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:12.501103 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bc230e26-4bea-4017-bcd4-2a9cfd791022 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:12.501613 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bc230e26-4bea-4017-bcd4-2a9cfd791022 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:12.528006 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-bc230e26-4bea-4017-bcd4-2a9cfd791022 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Going to try to terminate instance {{(pid=117646) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 10:32:12.607210 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-bc230e26-4bea-4017-bcd4-2a9cfd791022 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba" status: 204 len: 0 microversion: 2.1 time: 0.118413 Jul 07 10:32:12.608287 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 345/667] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jul 7 10:32:12 2022] DELETE /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 10:32:12.612935 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-4e45d353-56ee-40fb-b294-f0a8acf55167 req-bcf294df-7d3a-43c8-b910-63ae824d4f04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3963fd-1a48-4f86-a15e-c4fbcadc5911", "name": "network-vif-plugged", "status": "completed", "tag": "52658524-0e22-481a-99ab-eb339029366f"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:32:12.618034 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-6f02a08b-1a65-4dab-a545-e42d0e254a57 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:12.618848 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-6f02a08b-1a65-4dab-a545-e42d0e254a57 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:12.622422 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-4e45d353-56ee-40fb-b294-f0a8acf55167 req-bcf294df-7d3a-43c8-b910-63ae824d4f04 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:12.623078 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-4e45d353-56ee-40fb-b294-f0a8acf55167 req-bcf294df-7d3a-43c8-b910-63ae824d4f04 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:12.625067 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6f02a08b-1a65-4dab-a545-e42d0e254a57 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:12.625527 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6f02a08b-1a65-4dab-a545-e42d0e254a57 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:12.626326 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6f02a08b-1a65-4dab-a545-e42d0e254a57 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:12.626765 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6f02a08b-1a65-4dab-a545-e42d0e254a57 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:12.634721 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-4e45d353-56ee-40fb-b294-f0a8acf55167 req-bcf294df-7d3a-43c8-b910-63ae824d4f04 service nova] Creating event network-vif-plugged:52658524-0e22-481a-99ab-eb339029366f for instance 5f3963fd-1a48-4f86-a15e-c4fbcadc5911 on hv-cinder-82282 Jul 07 10:32:12.639712 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-4e45d353-56ee-40fb-b294-f0a8acf55167 req-bcf294df-7d3a-43c8-b910-63ae824d4f04 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035014 Jul 07 10:32:12.640607 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 323/668] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 10:32:12.753810 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-6f02a08b-1a65-4dab-a545-e42d0e254a57 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:12.761295 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-6f02a08b-1a65-4dab-a545-e42d0e254a57 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba" status: 200 len: 1673 microversion: 2.1 time: 0.148523 Jul 07 10:32:12.761857 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 346/669] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:12 2022] GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:32:13.780119 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0d12a1ff-b4b6-4f46-ab1b-5400862241f0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:13.780744 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0d12a1ff-b4b6-4f46-ab1b-5400862241f0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:13.786969 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0d12a1ff-b4b6-4f46-ab1b-5400862241f0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:13.787423 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0d12a1ff-b4b6-4f46-ab1b-5400862241f0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:13.788217 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0d12a1ff-b4b6-4f46-ab1b-5400862241f0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:13.788661 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0d12a1ff-b4b6-4f46-ab1b-5400862241f0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:13.914961 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0d12a1ff-b4b6-4f46-ab1b-5400862241f0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:13.922426 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0d12a1ff-b4b6-4f46-ab1b-5400862241f0 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba" status: 200 len: 1673 microversion: 2.1 time: 0.147166 Jul 07 10:32:13.922989 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 324/670] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:13 2022] GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:32:14.939401 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-4ecc1558-4d1f-45e4-ab6f-226984dfeb3c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:14.940119 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-4ecc1558-4d1f-45e4-ab6f-226984dfeb3c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:14.947320 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4ecc1558-4d1f-45e4-ab6f-226984dfeb3c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:14.947797 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4ecc1558-4d1f-45e4-ab6f-226984dfeb3c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:14.948599 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4ecc1558-4d1f-45e4-ab6f-226984dfeb3c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:14.949040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4ecc1558-4d1f-45e4-ab6f-226984dfeb3c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:15.087541 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-4ecc1558-4d1f-45e4-ab6f-226984dfeb3c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247787cd745444f38953a64780d6ac9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98924fde961c41358ffb24ac3819557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:15.095313 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-4ecc1558-4d1f-45e4-ab6f-226984dfeb3c tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba" status: 200 len: 1673 microversion: 2.1 time: 0.159951 Jul 07 10:32:15.095917 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 347/671] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:14 2022] GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:15.307225 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-2a2c841f-ad5e-4618-9d75-2a111068689d req-d120cb00-6785-4399-bffc-54147795b0be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c12068c-75fc-441d-872b-046be6efeeba", "name": "network-vif-deleted", "tag": "bad5fc6c-9e27-456d-9310-528cd132eb27"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:32:15.316965 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-2a2c841f-ad5e-4618-9d75-2a111068689d req-d120cb00-6785-4399-bffc-54147795b0be service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:15.317651 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-2a2c841f-ad5e-4618-9d75-2a111068689d req-d120cb00-6785-4399-bffc-54147795b0be service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:15.330693 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-2a2c841f-ad5e-4618-9d75-2a111068689d req-d120cb00-6785-4399-bffc-54147795b0be service nova] Creating event network-vif-deleted:bad5fc6c-9e27-456d-9310-528cd132eb27 for instance 4c12068c-75fc-441d-872b-046be6efeeba on hv-cinder-82282 Jul 07 10:32:15.336133 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-2a2c841f-ad5e-4618-9d75-2a111068689d req-d120cb00-6785-4399-bffc-54147795b0be service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033250 Jul 07 10:32:15.336825 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 325/672] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:32:16.113614 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-aafd4c59-9686-409e-acd2-8330b30143fc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:16.114862 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-aafd4c59-9686-409e-acd2-8330b30143fc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:16.122312 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-aafd4c59-9686-409e-acd2-8330b30143fc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:16.122794 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-aafd4c59-9686-409e-acd2-8330b30143fc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:16.123615 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-aafd4c59-9686-409e-acd2-8330b30143fc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:16.124571 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-aafd4c59-9686-409e-acd2-8330b30143fc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:16.139218 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.wsgi [None req-aafd4c59-9686-409e-acd2-8330b30143fc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] HTTP exception thrown: Instance 4c12068c-75fc-441d-872b-046be6efeeba could not be found. Jul 07 10:32:16.140905 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-aafd4c59-9686-409e-acd2-8330b30143fc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Request method failure captured: Jul 07 10:32:16.140905 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba HTTP/1.1 Jul 07 10:32:16.140905 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:32:16.140905 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:32:16.140905 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:32:16.140905 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 0 Jul 07 10:32:16.140905 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:32:16.140905 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:32:16.140905 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:32:16.140905 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:32:16.140905 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrS2CO6Q7wY8_KtEd72k98g5X8mz9ws6rDrkmXy7itq_fzajI2OiMopidCXdHexrLwHj7jg6YyAlzqalbXHstoqHcVpwLOjCfZern2P_WHykfXakXHVGQjV1s462g60dIKQh97Phl0wAVhWIP5HhcRfOcwMz0nAW9gYkMLF5mIE0Gxw Jul 07 10:32:16.140905 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:32:16.140905 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:32:16.140905 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:32:16.140905 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:32:16.140905 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:32:16.140905 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:32:16.140905 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: 98924fde961c41358ffb24ac3819557a Jul 07 10:32:16.140905 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-AttachVolumeTestJSON-11612011 Jul 07 10:32:16.140905 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:32:16.140905 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:32:16.142519 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98924fde961c41358ffb24ac3819557a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/98924fde961c41358ffb24ac3819557a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98924fde961c41358ffb24ac3819557a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_98924fde961c41358ffb24ac3819557a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:32:16.142519 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-AttachVolumeTestJSON-11612011 Jul 07 10:32:16.142519 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: 98924fde961c41358ffb24ac3819557a Jul 07 10:32:16.142519 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-AttachVolumeTestJSON-11612011 Jul 07 10:32:16.142519 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-AttachVolumeTestJSON-11612011-project Jul 07 10:32:16.142519 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:32:16.142519 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:32:16.142519 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: 247787cd745444f38953a64780d6ac9b Jul 07 10:32:16.142519 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-AttachVolumeTestJSON-11612011-project Jul 07 10:32:16.142519 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: > Jul 07 10:32:16.142519 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Instance 4c12068c-75fc-441d-872b-046be6efeeba could not be found. Jul 07 10:32:16.142519 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'id': '4c12068c-75fc-441d-872b-046be6efeeba'} Jul 07 10:32:16.147606 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:32:16.147606 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:32:16.147606 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:32:16.147606 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:32:16.147606 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:32:16.147606 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:32:16.147606 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:32:16.147606 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:32:16.147606 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:32:16.147606 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:32:16.147606 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c12068c-75fc-441d-872b-046be6efeeba could not be found. Jul 07 10:32:16.147606 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:32:16.147606 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:32:16.147606 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:32:16.147606 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:32:16.147606 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:32:16.147606 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:32:16.147606 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:32:16.147606 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:32:16.147606 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:32:16.149155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:32:16.149155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:32:16.149155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:32:16.149155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:32:16.149155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:32:16.149155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:32:16.149155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:32:16.149155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c12068c-75fc-441d-872b-046be6efeeba could not be found. Jul 07 10:32:16.149155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:32:16.149155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:32:16.149155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:32:16.149155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:32:16.149155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:32:16.149155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:32:16.149155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:32:16.149155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:32:16.149155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c12068c-75fc-441d-872b-046be6efeeba could not be found. Jul 07 10:32:16.149155 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:32:16.150572 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-aafd4c59-9686-409e-acd2-8330b30143fc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Returning 404 to user: Instance 4c12068c-75fc-441d-872b-046be6efeeba could not be found. {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:32:16.150572 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-aafd4c59-9686-409e-acd2-8330b30143fc tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba" status: 404 len: 111 microversion: 2.1 time: 0.033035 Jul 07 10:32:16.150572 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 348/673] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:16 2022] GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:32:16.151558 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4d54687d-e187-4cbe-b54e-d4ddfcd68591 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '.version_select at 0x7f9e9e360e50>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:16.169408 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-4d54687d-e187-4cbe-b54e-d4ddfcd68591 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1210705166" status: 202 len: 0 microversion: 2.1 time: 0.021825 Jul 07 10:32:16.170178 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 326/674] 10.222.0.16 () {58 vars in 1220 bytes} [Thu Jul 7 10:32:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1210705166 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 10:32:19.006555 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a72b1440-49c0-4b21-bedc-ccbe8d8aada7 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:19.007051 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-a72b1440-49c0-4b21-bedc-ccbe8d8aada7 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:19.014647 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a72b1440-49c0-4b21-bedc-ccbe8d8aada7 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:19.015250 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a72b1440-49c0-4b21-bedc-ccbe8d8aada7 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:19.016037 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a72b1440-49c0-4b21-bedc-ccbe8d8aada7 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:19.016472 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a72b1440-49c0-4b21-bedc-ccbe8d8aada7 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:19.029931 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.wsgi [None req-a72b1440-49c0-4b21-bedc-ccbe8d8aada7 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] HTTP exception thrown: Instance 4c12068c-75fc-441d-872b-046be6efeeba could not be found. Jul 07 10:32:19.031470 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a72b1440-49c0-4b21-bedc-ccbe8d8aada7 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Request method failure captured: Jul 07 10:32:19.031470 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: DELETE /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba HTTP/1.1 Jul 07 10:32:19.031470 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:32:19.031470 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:32:19.031470 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:32:19.031470 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 0 Jul 07 10:32:19.031470 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:32:19.031470 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:32:19.031470 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:32:19.031470 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:32:19.031470 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrS2CO6Q7wY8_KtEd72k98g5X8mz9ws6rDrkmXy7itq_fzajI2OiMopidCXdHexrLwHj7jg6YyAlzqalbXHstoqHcVpwLOjCfZern2P_WHykfXakXHVGQjV1s462g60dIKQh97Phl0wAVhWIP5HhcRfOcwMz0nAW9gYkMLF5mIE0Gxw Jul 07 10:32:19.031470 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:32:19.031470 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:32:19.031470 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:32:19.031470 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:32:19.031470 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:32:19.031470 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:32:19.031470 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: 98924fde961c41358ffb24ac3819557a Jul 07 10:32:19.031470 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-AttachVolumeTestJSON-11612011 Jul 07 10:32:19.031470 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:32:19.031470 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:32:19.032987 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98924fde961c41358ffb24ac3819557a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/98924fde961c41358ffb24ac3819557a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98924fde961c41358ffb24ac3819557a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_98924fde961c41358ffb24ac3819557a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:32:19.032987 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-AttachVolumeTestJSON-11612011 Jul 07 10:32:19.032987 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: 98924fde961c41358ffb24ac3819557a Jul 07 10:32:19.032987 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-AttachVolumeTestJSON-11612011 Jul 07 10:32:19.032987 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-AttachVolumeTestJSON-11612011-project Jul 07 10:32:19.032987 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:32:19.032987 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:32:19.032987 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: 247787cd745444f38953a64780d6ac9b Jul 07 10:32:19.032987 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-AttachVolumeTestJSON-11612011-project Jul 07 10:32:19.032987 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: > Jul 07 10:32:19.032987 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Instance 4c12068c-75fc-441d-872b-046be6efeeba could not be found. Jul 07 10:32:19.032987 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'id': '4c12068c-75fc-441d-872b-046be6efeeba'} Jul 07 10:32:19.034018 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:32:19.034018 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:32:19.034018 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:32:19.034018 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:32:19.034018 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:32:19.034018 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:32:19.034018 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:32:19.034018 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:32:19.034018 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:32:19.034018 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:32:19.034018 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c12068c-75fc-441d-872b-046be6efeeba could not be found. Jul 07 10:32:19.034018 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:32:19.034018 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:32:19.034018 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:32:19.034018 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:32:19.034018 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:32:19.034018 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:32:19.034018 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:32:19.034018 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:32:19.034018 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:32:19.035491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:32:19.035491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 10:32:19.035491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 10:32:19.035491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 10:32:19.035491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 10:32:19.035491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:32:19.035491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:32:19.035491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:32:19.035491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:32:19.035491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c12068c-75fc-441d-872b-046be6efeeba could not be found. Jul 07 10:32:19.035491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:32:19.035491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:32:19.035491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:32:19.035491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:32:19.035491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:32:19.035491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:32:19.035491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:32:19.035491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:32:19.035491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c12068c-75fc-441d-872b-046be6efeeba could not be found. Jul 07 10:32:19.035491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:32:19.036988 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a72b1440-49c0-4b21-bedc-ccbe8d8aada7 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Returning 404 to user: Instance 4c12068c-75fc-441d-872b-046be6efeeba could not be found. {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:32:19.036988 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-a72b1440-49c0-4b21-bedc-ccbe8d8aada7 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba" status: 404 len: 111 microversion: 2.1 time: 0.030594 Jul 07 10:32:19.036988 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 349/675] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jul 7 10:32:19 2022] DELETE /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:32:19.041725 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4631517e-4b5b-4da9-b518-ff60747745f9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:19.042447 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-4631517e-4b5b-4da9-b518-ff60747745f9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: 4c12068c-75fc-441d-872b-046be6efeeba] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:19.048539 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4631517e-4b5b-4da9-b518-ff60747745f9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:19.048988 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4631517e-4b5b-4da9-b518-ff60747745f9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:19.049741 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4631517e-4b5b-4da9-b518-ff60747745f9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:19.050174 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4631517e-4b5b-4da9-b518-ff60747745f9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:19.063342 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-4631517e-4b5b-4da9-b518-ff60747745f9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] HTTP exception thrown: Instance 4c12068c-75fc-441d-872b-046be6efeeba could not be found. Jul 07 10:32:19.064979 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4631517e-4b5b-4da9-b518-ff60747745f9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Request method failure captured: Jul 07 10:32:19.064979 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba HTTP/1.1 Jul 07 10:32:19.064979 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept: application/json Jul 07 10:32:19.064979 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jul 07 10:32:19.064979 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Connection: close Jul 07 10:32:19.064979 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jul 07 10:32:19.064979 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jul 07 10:32:19.064979 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Host: 10.222.0.16 Jul 07 10:32:19.064979 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jul 07 10:32:19.064979 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jul 07 10:32:19.064979 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABixrS2CO6Q7wY8_KtEd72k98g5X8mz9ws6rDrkmXy7itq_fzajI2OiMopidCXdHexrLwHj7jg6YyAlzqalbXHstoqHcVpwLOjCfZern2P_WHykfXakXHVGQjV1s462g60dIKQh97Phl0wAVhWIP5HhcRfOcwMz0nAW9gYkMLF5mIE0Gxw Jul 07 10:32:19.064979 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jul 07 10:32:19.064979 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jul 07 10:32:19.064979 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jul 07 10:32:19.064979 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jul 07 10:32:19.064979 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jul 07 10:32:19.064979 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jul 07 10:32:19.064979 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Id: 98924fde961c41358ffb24ac3819557a Jul 07 10:32:19.064979 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-AttachVolumeTestJSON-11612011 Jul 07 10:32:19.064979 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jul 07 10:32:19.064979 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jul 07 10:32:19.066458 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98924fde961c41358ffb24ac3819557a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/98924fde961c41358ffb24ac3819557a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98924fde961c41358ffb24ac3819557a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_98924fde961c41358ffb24ac3819557a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:32:19.066458 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-AttachVolumeTestJSON-11612011 Jul 07 10:32:19.066458 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 98924fde961c41358ffb24ac3819557a Jul 07 10:32:19.066458 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-AttachVolumeTestJSON-11612011 Jul 07 10:32:19.066458 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User: tempest-AttachVolumeTestJSON-11612011-project Jul 07 10:32:19.066458 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jul 07 10:32:19.066458 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jul 07 10:32:19.066458 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Id: 247787cd745444f38953a64780d6ac9b Jul 07 10:32:19.066458 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-AttachVolumeTestJSON-11612011-project Jul 07 10:32:19.066458 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: method: > Jul 07 10:32:19.066458 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: exception: Instance 4c12068c-75fc-441d-872b-046be6efeeba could not be found. Jul 07 10:32:19.066458 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: action_args: {'id': '4c12068c-75fc-441d-872b-046be6efeeba'} Jul 07 10:32:19.067400 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:32:19.067400 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:32:19.067400 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:32:19.067400 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:32:19.067400 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:32:19.067400 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:32:19.067400 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:32:19.067400 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:32:19.067400 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:32:19.067400 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:32:19.067400 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c12068c-75fc-441d-872b-046be6efeeba could not be found. Jul 07 10:32:19.067400 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:32:19.067400 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:32:19.067400 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:32:19.067400 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:32:19.067400 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:32:19.067400 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:32:19.067400 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:32:19.067400 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:32:19.067400 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:32:19.069241 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:32:19.069241 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:32:19.069241 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:32:19.069241 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:32:19.069241 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:32:19.069241 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:32:19.069241 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:32:19.069241 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c12068c-75fc-441d-872b-046be6efeeba could not be found. Jul 07 10:32:19.069241 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:32:19.069241 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:32:19.069241 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:32:19.069241 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:32:19.069241 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:32:19.069241 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:32:19.069241 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:32:19.069241 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:32:19.069241 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c12068c-75fc-441d-872b-046be6efeeba could not be found. Jul 07 10:32:19.069241 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:32:19.071143 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4631517e-4b5b-4da9-b518-ff60747745f9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Returning 404 to user: Instance 4c12068c-75fc-441d-872b-046be6efeeba could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:32:19.071143 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-4631517e-4b5b-4da9-b518-ff60747745f9 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba" status: 404 len: 111 microversion: 2.1 time: 0.029163 Jul 07 10:32:19.071143 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 327/676] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:19 2022] GET /compute/v2.1/servers/4c12068c-75fc-441d-872b-046be6efeeba => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:32:20.200330 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-f81b6205-b51d-4f1b-a19c-58e036495f12 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:20.200836 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-f81b6205-b51d-4f1b-a19c-58e036495f12 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:20.207548 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f81b6205-b51d-4f1b-a19c-58e036495f12 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:20.208026 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f81b6205-b51d-4f1b-a19c-58e036495f12 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:20.208845 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f81b6205-b51d-4f1b-a19c-58e036495f12 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:20.209264 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f81b6205-b51d-4f1b-a19c-58e036495f12 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:20.222635 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.wsgi [None req-f81b6205-b51d-4f1b-a19c-58e036495f12 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] HTTP exception thrown: Instance b00a3c72-669b-41e2-a9b9-1a2921bcabe0 could not be found. Jul 07 10:32:20.224358 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-f81b6205-b51d-4f1b-a19c-58e036495f12 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Request method failure captured: Jul 07 10:32:20.224358 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: DELETE /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 HTTP/1.1 Jul 07 10:32:20.224358 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:32:20.224358 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:32:20.224358 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:32:20.224358 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 0 Jul 07 10:32:20.224358 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:32:20.224358 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:32:20.224358 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:32:20.224358 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:32:20.224358 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrS2CO6Q7wY8_KtEd72k98g5X8mz9ws6rDrkmXy7itq_fzajI2OiMopidCXdHexrLwHj7jg6YyAlzqalbXHstoqHcVpwLOjCfZern2P_WHykfXakXHVGQjV1s462g60dIKQh97Phl0wAVhWIP5HhcRfOcwMz0nAW9gYkMLF5mIE0Gxw Jul 07 10:32:20.224358 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:32:20.224358 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:32:20.224358 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:32:20.224358 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:32:20.224358 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:32:20.224358 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:32:20.224358 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: 98924fde961c41358ffb24ac3819557a Jul 07 10:32:20.224358 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-AttachVolumeTestJSON-11612011 Jul 07 10:32:20.224358 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:32:20.224358 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:32:20.225685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98924fde961c41358ffb24ac3819557a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/98924fde961c41358ffb24ac3819557a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98924fde961c41358ffb24ac3819557a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_98924fde961c41358ffb24ac3819557a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:32:20.225685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-AttachVolumeTestJSON-11612011 Jul 07 10:32:20.225685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: 98924fde961c41358ffb24ac3819557a Jul 07 10:32:20.225685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-AttachVolumeTestJSON-11612011 Jul 07 10:32:20.225685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-AttachVolumeTestJSON-11612011-project Jul 07 10:32:20.225685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:32:20.225685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:32:20.225685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: 247787cd745444f38953a64780d6ac9b Jul 07 10:32:20.225685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-AttachVolumeTestJSON-11612011-project Jul 07 10:32:20.225685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: > Jul 07 10:32:20.225685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Instance b00a3c72-669b-41e2-a9b9-1a2921bcabe0 could not be found. Jul 07 10:32:20.225685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'id': 'b00a3c72-669b-41e2-a9b9-1a2921bcabe0'} Jul 07 10:32:20.226406 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:32:20.226406 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:32:20.226406 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:32:20.226406 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:32:20.226406 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:32:20.226406 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:32:20.226406 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:32:20.226406 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:32:20.226406 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:32:20.226406 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:32:20.226406 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b00a3c72-669b-41e2-a9b9-1a2921bcabe0 could not be found. Jul 07 10:32:20.226406 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:32:20.226406 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:32:20.226406 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:32:20.226406 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:32:20.226406 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:32:20.226406 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:32:20.226406 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:32:20.226406 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:32:20.226406 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:32:20.228677 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:32:20.228677 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 10:32:20.228677 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 10:32:20.228677 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 10:32:20.228677 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 10:32:20.228677 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:32:20.228677 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:32:20.228677 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:32:20.228677 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:32:20.228677 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b00a3c72-669b-41e2-a9b9-1a2921bcabe0 could not be found. Jul 07 10:32:20.228677 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:32:20.228677 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:32:20.228677 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:32:20.228677 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:32:20.228677 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:32:20.228677 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:32:20.228677 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:32:20.228677 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:32:20.228677 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b00a3c72-669b-41e2-a9b9-1a2921bcabe0 could not be found. Jul 07 10:32:20.228677 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:32:20.230078 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-f81b6205-b51d-4f1b-a19c-58e036495f12 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Returning 404 to user: Instance b00a3c72-669b-41e2-a9b9-1a2921bcabe0 could not be found. {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:32:20.230078 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-f81b6205-b51d-4f1b-a19c-58e036495f12 tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 404 len: 111 microversion: 2.1 time: 0.030121 Jul 07 10:32:20.230078 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 350/677] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jul 7 10:32:20 2022] DELETE /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:32:20.234477 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0cd265cb-7772-47d6-b3d1-0faa2c53ea5b tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:20.235096 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0cd265cb-7772-47d6-b3d1-0faa2c53ea5b tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] [instance: b00a3c72-669b-41e2-a9b9-1a2921bcabe0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:20.237510 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:32:20.243661 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0cd265cb-7772-47d6-b3d1-0faa2c53ea5b tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:20.244143 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0cd265cb-7772-47d6-b3d1-0faa2c53ea5b tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:20.245200 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0cd265cb-7772-47d6-b3d1-0faa2c53ea5b tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:20.245696 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0cd265cb-7772-47d6-b3d1-0faa2c53ea5b tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:20.261979 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-0cd265cb-7772-47d6-b3d1-0faa2c53ea5b tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] HTTP exception thrown: Instance b00a3c72-669b-41e2-a9b9-1a2921bcabe0 could not be found. Jul 07 10:32:20.263531 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0cd265cb-7772-47d6-b3d1-0faa2c53ea5b tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Request method failure captured: Jul 07 10:32:20.263531 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 HTTP/1.1 Jul 07 10:32:20.263531 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept: application/json Jul 07 10:32:20.263531 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jul 07 10:32:20.263531 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Connection: close Jul 07 10:32:20.263531 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jul 07 10:32:20.263531 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jul 07 10:32:20.263531 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Host: 10.222.0.16 Jul 07 10:32:20.263531 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jul 07 10:32:20.263531 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jul 07 10:32:20.263531 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABixrS2CO6Q7wY8_KtEd72k98g5X8mz9ws6rDrkmXy7itq_fzajI2OiMopidCXdHexrLwHj7jg6YyAlzqalbXHstoqHcVpwLOjCfZern2P_WHykfXakXHVGQjV1s462g60dIKQh97Phl0wAVhWIP5HhcRfOcwMz0nAW9gYkMLF5mIE0Gxw Jul 07 10:32:20.263531 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jul 07 10:32:20.263531 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jul 07 10:32:20.263531 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jul 07 10:32:20.263531 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jul 07 10:32:20.263531 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jul 07 10:32:20.263531 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jul 07 10:32:20.263531 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Id: 98924fde961c41358ffb24ac3819557a Jul 07 10:32:20.263531 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-AttachVolumeTestJSON-11612011 Jul 07 10:32:20.263531 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jul 07 10:32:20.263531 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jul 07 10:32:20.265210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98924fde961c41358ffb24ac3819557a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/98924fde961c41358ffb24ac3819557a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98924fde961c41358ffb24ac3819557a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_98924fde961c41358ffb24ac3819557a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:32:20.265210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-AttachVolumeTestJSON-11612011 Jul 07 10:32:20.265210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 98924fde961c41358ffb24ac3819557a Jul 07 10:32:20.265210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-AttachVolumeTestJSON-11612011 Jul 07 10:32:20.265210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User: tempest-AttachVolumeTestJSON-11612011-project Jul 07 10:32:20.265210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jul 07 10:32:20.265210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jul 07 10:32:20.265210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Id: 247787cd745444f38953a64780d6ac9b Jul 07 10:32:20.265210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-AttachVolumeTestJSON-11612011-project Jul 07 10:32:20.265210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: method: > Jul 07 10:32:20.265210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: exception: Instance b00a3c72-669b-41e2-a9b9-1a2921bcabe0 could not be found. Jul 07 10:32:20.265210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: action_args: {'id': 'b00a3c72-669b-41e2-a9b9-1a2921bcabe0'} Jul 07 10:32:20.265914 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:32:20.265914 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:32:20.265914 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:32:20.265914 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:32:20.265914 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:32:20.265914 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:32:20.265914 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:32:20.265914 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:32:20.265914 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:32:20.265914 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:32:20.265914 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b00a3c72-669b-41e2-a9b9-1a2921bcabe0 could not be found. Jul 07 10:32:20.265914 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:32:20.265914 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:32:20.265914 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:32:20.265914 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:32:20.265914 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:32:20.265914 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:32:20.265914 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:32:20.265914 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:32:20.265914 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:32:20.267361 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:32:20.267361 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:32:20.267361 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:32:20.267361 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:32:20.267361 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:32:20.267361 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:32:20.267361 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:32:20.267361 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b00a3c72-669b-41e2-a9b9-1a2921bcabe0 could not be found. Jul 07 10:32:20.267361 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:32:20.267361 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:32:20.267361 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:32:20.267361 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:32:20.267361 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:32:20.267361 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:32:20.267361 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:32:20.267361 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:32:20.267361 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b00a3c72-669b-41e2-a9b9-1a2921bcabe0 could not be found. Jul 07 10:32:20.267361 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:32:20.268670 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0cd265cb-7772-47d6-b3d1-0faa2c53ea5b tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] Returning 404 to user: Instance b00a3c72-669b-41e2-a9b9-1a2921bcabe0 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:32:20.268670 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0cd265cb-7772-47d6-b3d1-0faa2c53ea5b tempest-AttachVolumeTestJSON-11612011 tempest-AttachVolumeTestJSON-11612011-project] 10.222.0.16 "GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0" status: 404 len: 111 microversion: 2.1 time: 0.034476 Jul 07 10:32:20.268670 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 328/678] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:20 2022] GET /compute/v2.1/servers/b00a3c72-669b-41e2-a9b9-1a2921bcabe0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:32:27.359245 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-f8c9651d-183d-4e88-9cf6-5e9140ce1127 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:27.359961 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-f8c9651d-183d-4e88-9cf6-5e9140ce1127 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:27.362447 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:32:27.367872 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f8c9651d-183d-4e88-9cf6-5e9140ce1127 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:27.368333 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f8c9651d-183d-4e88-9cf6-5e9140ce1127 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:27.369110 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f8c9651d-183d-4e88-9cf6-5e9140ce1127 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:27.369548 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f8c9651d-183d-4e88-9cf6-5e9140ce1127 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:27.390617 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:32:27.400113 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-f8c9651d-183d-4e88-9cf6-5e9140ce1127 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] Going to try to terminate instance {{(pid=117646) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 10:32:27.494805 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-f8c9651d-183d-4e88-9cf6-5e9140ce1127 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428" status: 204 len: 0 microversion: 2.1 time: 0.139186 Jul 07 10:32:27.500453 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 351/679] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jul 7 10:32:27 2022] DELETE /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 10:32:27.507076 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-83fcb53f-b84a-4958-b0ed-743bc2e81992 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:27.509142 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-83fcb53f-b84a-4958-b0ed-743bc2e81992 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:27.523456 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-83fcb53f-b84a-4958-b0ed-743bc2e81992 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:27.527153 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-83fcb53f-b84a-4958-b0ed-743bc2e81992 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:27.530134 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-83fcb53f-b84a-4958-b0ed-743bc2e81992 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:27.530677 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-83fcb53f-b84a-4958-b0ed-743bc2e81992 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:27.702671 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-83fcb53f-b84a-4958-b0ed-743bc2e81992 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:27.712579 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-83fcb53f-b84a-4958-b0ed-743bc2e81992 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428" status: 200 len: 1575 microversion: 2.1 time: 0.210997 Jul 07 10:32:27.714214 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 329/680] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:27 2022] GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 => generated 1575 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:28.612909 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-53df4586-6180-4929-a5ae-35f215c47794 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Action: 'create', calling method: .version_select at 0x7f9e9e40cc10>, body: {"keypair": {"name": "tempest-keypair-1258290886", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMjIKwpmUDlYpn9+OeytxSYmKstt1sltF9OKWw2KKQNSwcNXSYxz/inGDPN6nfx3C9BEYnEArLK04Zk7Lk7FXbZc/gWKC8dtUoWFsQLyXQMR5WaCsL7+nRztIo5S7c4+A=="}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:32:28.628253 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-53df4586-6180-4929-a5ae-35f215c47794 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Getting quotas for project 1568d5b1c4bb471f9de53f4d5cf7cc82. Resources: {'key_pairs'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:32:28.632147 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-53df4586-6180-4929-a5ae-35f215c47794 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Getting quotas for user 1222d8bb50554d64ac674f109b6ad077 and project 1568d5b1c4bb471f9de53f4d5cf7cc82. Resources: {'key_pairs'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:32:28.655649 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-53df4586-6180-4929-a5ae-35f215c47794 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.167821 Jul 07 10:32:28.656294 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 352/681] 10.222.0.16 () {60 vars in 1158 bytes} [Thu Jul 7 10:32:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:32:28.731401 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b462f8b7-d599-410e-a365-2660a858710f tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:28.732071 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b462f8b7-d599-410e-a365-2660a858710f tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:28.739366 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b462f8b7-d599-410e-a365-2660a858710f tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:28.740094 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b462f8b7-d599-410e-a365-2660a858710f tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:28.740879 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b462f8b7-d599-410e-a365-2660a858710f tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:28.741474 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b462f8b7-d599-410e-a365-2660a858710f tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:28.746740 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:32:28.800068 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a9219026-7662-48a5-9895-f80371113797 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:28.800803 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-a9219026-7662-48a5-9895-f80371113797 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:28.816381 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a9219026-7662-48a5-9895-f80371113797 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:28.816929 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a9219026-7662-48a5-9895-f80371113797 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:28.818505 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a9219026-7662-48a5-9895-f80371113797 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:28.819203 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a9219026-7662-48a5-9895-f80371113797 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:28.845510 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-a9219026-7662-48a5-9895-f80371113797 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f/ips" status: 200 len: 152 microversion: 2.20 time: 0.051285 Jul 07 10:32:28.847573 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 353/682] 10.222.0.16 () {60 vars in 1288 bytes} [Thu Jul 7 10:32:28 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f/ips => generated 152 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 07 10:32:28.921782 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b462f8b7-d599-410e-a365-2660a858710f tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:28.930264 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b462f8b7-d599-410e-a365-2660a858710f tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428" status: 200 len: 1575 microversion: 2.1 time: 0.202410 Jul 07 10:32:28.931143 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 330/683] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:28 2022] GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 => generated 1575 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:29.949388 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-7d1bdf2c-c890-4c45-8d7b-378ce21efe7e tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:29.950018 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-7d1bdf2c-c890-4c45-8d7b-378ce21efe7e tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:29.964870 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7d1bdf2c-c890-4c45-8d7b-378ce21efe7e tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:29.966086 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7d1bdf2c-c890-4c45-8d7b-378ce21efe7e tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:29.968796 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7d1bdf2c-c890-4c45-8d7b-378ce21efe7e tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:29.969301 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7d1bdf2c-c890-4c45-8d7b-378ce21efe7e tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:30.012048 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-50314b5a-3004-43b3-9f68-671795edaed4 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-757408467", "imageRef": "1c96509d-f65f-42b0-94b3-6fc590a93508", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ddda3840-6dd5-4197-ae4c-bd6a56e53d5c"}], "security_groups": [{"name": "tempest-securitygroup--1485750860"}], "key_name": "tempest-keypair-1258290886", "user_data": "}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:32:30.052286 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-7d1bdf2c-c890-4c45-8d7b-378ce21efe7e tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:30.060611 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-7d1bdf2c-c890-4c45-8d7b-378ce21efe7e tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428" status: 200 len: 1509 microversion: 2.1 time: 0.116124 Jul 07 10:32:30.061685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 354/684] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:29 2022] GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 => generated 1509 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:30.205899 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.network.neutron [None req-50314b5a-3004-43b3-9f68-671795edaed4 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] validate_networks() for [('ddda3840-6dd5-4197-ae4c-bd6a56e53d5c', None, None, None, None, None)] {{(pid=117647) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 10:32:30.307317 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-d30f3588-70f6-483e-8450-4fd6c442d355 req-a7f39991-e277-43c6-ade4-18d25fb06391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2364e764-0c0a-493f-bc92-2f8701294428", "name": "network-vif-deleted", "tag": "552f5d9a-f502-4184-a7a5-3082829225b5"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:32:30.328179 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-d30f3588-70f6-483e-8450-4fd6c442d355 req-a7f39991-e277-43c6-ade4-18d25fb06391 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:30.328938 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-d30f3588-70f6-483e-8450-4fd6c442d355 req-a7f39991-e277-43c6-ade4-18d25fb06391 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:30.344607 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-d30f3588-70f6-483e-8450-4fd6c442d355 req-a7f39991-e277-43c6-ade4-18d25fb06391 service nova] Creating event network-vif-deleted:552f5d9a-f502-4184-a7a5-3082829225b5 for instance 2364e764-0c0a-493f-bc92-2f8701294428 on hv-cinder-82282 Jul 07 10:32:30.360596 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-d30f3588-70f6-483e-8450-4fd6c442d355 req-a7f39991-e277-43c6-ade4-18d25fb06391 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053476 Jul 07 10:32:30.361315 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 355/685] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 10:32:30.876999 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-50314b5a-3004-43b3-9f68-671795edaed4 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Flavor limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 10:32:30.877663 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-50314b5a-3004-43b3-9f68-671795edaed4 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Image limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 10:32:30.878299 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-50314b5a-3004-43b3-9f68-671795edaed4 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Flavor pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 10:32:30.878867 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-50314b5a-3004-43b3-9f68-671795edaed4 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Image pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 10:32:30.879439 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-50314b5a-3004-43b3-9f68-671795edaed4 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 10:32:30.889428 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-50314b5a-3004-43b3-9f68-671795edaed4 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:30.889888 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-50314b5a-3004-43b3-9f68-671795edaed4 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:30.890684 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-50314b5a-3004-43b3-9f68-671795edaed4 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:30.891127 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-50314b5a-3004-43b3-9f68-671795edaed4 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:30.911902 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-c8975afa-b8a3-4ee3-a47a-beced23ba264 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:32:30.913880 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-c8975afa-b8a3-4ee3-a47a-beced23ba264 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:30.924949 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c8975afa-b8a3-4ee3-a47a-beced23ba264 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:30.927133 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c8975afa-b8a3-4ee3-a47a-beced23ba264 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:30.928949 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c8975afa-b8a3-4ee3-a47a-beced23ba264 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:30.929578 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c8975afa-b8a3-4ee3-a47a-beced23ba264 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:30.932381 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-50314b5a-3004-43b3-9f68-671795edaed4 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Getting quotas for project 1568d5b1c4bb471f9de53f4d5cf7cc82. Resources: {'cores', 'ram', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:32:30.936797 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-50314b5a-3004-43b3-9f68-671795edaed4 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Getting quotas for user 1222d8bb50554d64ac674f109b6ad077 and project 1568d5b1c4bb471f9de53f4d5cf7cc82. Resources: {'cores', 'ram', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:32:30.949571 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-50314b5a-3004-43b3-9f68-671795edaed4 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Going to run 1 instances... {{(pid=117647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 10:32:30.951978 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-50314b5a-3004-43b3-9f68-671795edaed4 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c96509d-f65f-42b0-94b3-6fc590a93508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 10:32:30.959328 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.objects.instance [None req-c8975afa-b8a3-4ee3-a47a-beced23ba264 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lazy-loading 'flavor' on Instance uuid b52e1947-1b4e-4a83-9041-ea3b84be027f {{(pid=117646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 10:32:31.044694 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-50314b5a-3004-43b3-9f68-671795edaed4 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.040021 Jul 07 10:32:31.046842 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 331/686] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jul 7 10:32:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 07 10:32:31.058801 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1a7f39e3-2618-4c99-b19f-bd88ed16e3b3 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:31.060227 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1a7f39e3-2618-4c99-b19f-bd88ed16e3b3 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:31.142020 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-1a7f39e3-2618-4c99-b19f-bd88ed16e3b3 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:31.152751 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1a7f39e3-2618-4c99-b19f-bd88ed16e3b3 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12" status: 200 len: 1241 microversion: 2.1 time: 0.097768 Jul 07 10:32:31.153982 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 332/687] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:31 2022] GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12 => generated 1241 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:31.159283 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-bc8f6d70-f787-4ab2-9e52-47b6aa223098 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:31.160345 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-bc8f6d70-f787-4ab2-9e52-47b6aa223098 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:31.169554 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bc8f6d70-f787-4ab2-9e52-47b6aa223098 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:31.170692 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bc8f6d70-f787-4ab2-9e52-47b6aa223098 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:31.171970 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bc8f6d70-f787-4ab2-9e52-47b6aa223098 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:31.172769 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bc8f6d70-f787-4ab2-9e52-47b6aa223098 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:31.226427 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bc8f6d70-f787-4ab2-9e52-47b6aa223098 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:31.227812 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bc8f6d70-f787-4ab2-9e52-47b6aa223098 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:31.228525 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.objects.instance [None req-bc8f6d70-f787-4ab2-9e52-47b6aa223098 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lazy-loading 'fault' on Instance uuid 2364e764-0c0a-493f-bc92-2f8701294428 {{(pid=117647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 10:32:31.302719 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-bc8f6d70-f787-4ab2-9e52-47b6aa223098 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:31.325036 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-bc8f6d70-f787-4ab2-9e52-47b6aa223098 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428" status: 200 len: 1184 microversion: 2.1 time: 0.169590 Jul 07 10:32:31.325991 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 333/688] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:31 2022] GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 => generated 1184 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:31.421705 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-c8975afa-b8a3-4ee3-a47a-beced23ba264 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "POST /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f/action" status: 202 len: 0 microversion: 2.20 time: 0.516096 Jul 07 10:32:31.426068 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 356/689] 10.222.0.16 () {62 vars in 1318 bytes} [Thu Jul 7 10:32:30 2022] POST /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f/action => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 07 10:32:31.431291 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4847f0f9-2b72-4b16-8531-ecefab4ad16a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:31.431961 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-4847f0f9-2b72-4b16-8531-ecefab4ad16a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:31.446639 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4847f0f9-2b72-4b16-8531-ecefab4ad16a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:31.447434 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4847f0f9-2b72-4b16-8531-ecefab4ad16a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:31.449224 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4847f0f9-2b72-4b16-8531-ecefab4ad16a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:31.449817 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4847f0f9-2b72-4b16-8531-ecefab4ad16a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:31.653180 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-4847f0f9-2b72-4b16-8531-ecefab4ad16a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:31.662079 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-4847f0f9-2b72-4b16-8531-ecefab4ad16a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:31.663792 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-4847f0f9-2b72-4b16-8531-ecefab4ad16a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:31.665058 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-4847f0f9-2b72-4b16-8531-ecefab4ad16a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1723 microversion: 2.20 time: 0.238187 Jul 07 10:32:31.676521 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 334/690] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:32:31 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 10:32:32.177635 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-3e6ca761-fab3-411f-b4f4-8a9ce0867359 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:32.178362 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-3e6ca761-fab3-411f-b4f4-8a9ce0867359 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:32.186504 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3e6ca761-fab3-411f-b4f4-8a9ce0867359 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:32.186955 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3e6ca761-fab3-411f-b4f4-8a9ce0867359 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:32.187737 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3e6ca761-fab3-411f-b4f4-8a9ce0867359 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:32.188260 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3e6ca761-fab3-411f-b4f4-8a9ce0867359 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:32.266642 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-3e6ca761-fab3-411f-b4f4-8a9ce0867359 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:32.277670 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-3e6ca761-fab3-411f-b4f4-8a9ce0867359 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12" status: 200 len: 1293 microversion: 2.1 time: 0.109374 Jul 07 10:32:32.278407 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 357/691] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:32 2022] GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12 => generated 1293 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:32.343524 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6757c33a-0ce3-4d58-8878-7db604e6b3f0 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:32.345092 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6757c33a-0ce3-4d58-8878-7db604e6b3f0 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:32.353790 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6757c33a-0ce3-4d58-8878-7db604e6b3f0 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:32.354665 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6757c33a-0ce3-4d58-8878-7db604e6b3f0 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:32.355920 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6757c33a-0ce3-4d58-8878-7db604e6b3f0 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:32.357131 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6757c33a-0ce3-4d58-8878-7db604e6b3f0 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:32.386302 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-6757c33a-0ce3-4d58-8878-7db604e6b3f0 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] HTTP exception thrown: Instance 2364e764-0c0a-493f-bc92-2f8701294428 could not be found. Jul 07 10:32:32.388681 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6757c33a-0ce3-4d58-8878-7db604e6b3f0 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Request method failure captured: Jul 07 10:32:32.388681 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 HTTP/1.1 Jul 07 10:32:32.388681 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept: application/json Jul 07 10:32:32.388681 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jul 07 10:32:32.388681 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Connection: close Jul 07 10:32:32.388681 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jul 07 10:32:32.388681 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jul 07 10:32:32.388681 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Host: 10.222.0.16 Jul 07 10:32:32.388681 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jul 07 10:32:32.388681 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jul 07 10:32:32.388681 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABixrWBVteUyCqdbDELQednwVozbqX_3TVDWbVerzXdDH8pThAeXJI6Hme7Aj69Po7w29VfH5QDBIIPdKnql24pcEXNAywLc35EX6qquSHxXTCKMvhd-Hr1rdv027OK_Q4fyHYTFD6BSCksK7MQq4TvwsxbU5DcDgS6He7rtehl8aUmUjg Jul 07 10:32:32.388681 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jul 07 10:32:32.388681 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jul 07 10:32:32.388681 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jul 07 10:32:32.388681 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jul 07 10:32:32.388681 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jul 07 10:32:32.388681 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jul 07 10:32:32.388681 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Id: 12a91d56e163442dacf4c5ce7b28a132 Jul 07 10:32:32.388681 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-TestVolumeBootPattern-929143946 Jul 07 10:32:32.388681 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jul 07 10:32:32.388681 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jul 07 10:32:32.389978 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/12a91d56e163442dacf4c5ce7b28a132"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/12a91d56e163442dacf4c5ce7b28a132"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/12a91d56e163442dacf4c5ce7b28a132"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_12a91d56e163442dacf4c5ce7b28a132"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:32:32.389978 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-TestVolumeBootPattern-929143946 Jul 07 10:32:32.389978 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 12a91d56e163442dacf4c5ce7b28a132 Jul 07 10:32:32.389978 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-TestVolumeBootPattern-929143946 Jul 07 10:32:32.389978 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User: tempest-TestVolumeBootPattern-929143946-project Jul 07 10:32:32.389978 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jul 07 10:32:32.389978 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jul 07 10:32:32.389978 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Id: 059a87a80fc547db8aeb3bb03003cd2c Jul 07 10:32:32.389978 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-TestVolumeBootPattern-929143946-project Jul 07 10:32:32.389978 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: method: > Jul 07 10:32:32.389978 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: exception: Instance 2364e764-0c0a-493f-bc92-2f8701294428 could not be found. Jul 07 10:32:32.389978 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: action_args: {'id': '2364e764-0c0a-493f-bc92-2f8701294428'} Jul 07 10:32:32.390741 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:32:32.390741 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:32:32.390741 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:32:32.390741 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:32:32.390741 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:32:32.390741 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:32:32.390741 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:32:32.390741 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:32:32.390741 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:32:32.390741 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:32:32.390741 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2364e764-0c0a-493f-bc92-2f8701294428 could not be found. Jul 07 10:32:32.390741 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:32:32.390741 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:32:32.390741 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:32:32.390741 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:32:32.390741 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:32:32.390741 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:32:32.390741 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:32:32.390741 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:32:32.390741 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:32:32.391996 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:32:32.391996 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:32:32.391996 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:32:32.391996 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:32:32.391996 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:32:32.391996 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:32:32.391996 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:32:32.391996 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2364e764-0c0a-493f-bc92-2f8701294428 could not be found. Jul 07 10:32:32.391996 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:32:32.391996 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:32:32.391996 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:32:32.391996 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:32:32.391996 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:32:32.391996 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:32:32.391996 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:32:32.391996 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:32:32.391996 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2364e764-0c0a-493f-bc92-2f8701294428 could not be found. Jul 07 10:32:32.391996 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:32:32.394491 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6757c33a-0ce3-4d58-8878-7db604e6b3f0 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Returning 404 to user: Instance 2364e764-0c0a-493f-bc92-2f8701294428 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:32:32.395631 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6757c33a-0ce3-4d58-8878-7db604e6b3f0 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428" status: 404 len: 111 microversion: 2.1 time: 0.056591 Jul 07 10:32:32.396322 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 335/692] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:32 2022] GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:32:32.550668 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-bb89275d-a815-48d7-a88d-02aa9bdaa123 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-639930347", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-800154750", "security_groups": [{"name": "tempest-secgroup-smoke-51530022"}], "block_device_mapping_v2": [{"uuid": "faf59746-87c7-41ff-9011-1af885e44e0a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "06199cd4-69ed-4b3c-bfad-2ede6bfd3a79"}]}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:32:32.669900 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.network.neutron [None req-bb89275d-a815-48d7-a88d-02aa9bdaa123 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] validate_networks() for [('06199cd4-69ed-4b3c-bfad-2ede6bfd3a79', None, None, None, None, None)] {{(pid=117646) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 10:32:32.684098 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-60d4e253-ba7c-42a4-81e7-ba0949d9a3f0 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:32.684987 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-60d4e253-ba7c-42a4-81e7-ba0949d9a3f0 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:32.692042 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-60d4e253-ba7c-42a4-81e7-ba0949d9a3f0 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:32.692734 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-60d4e253-ba7c-42a4-81e7-ba0949d9a3f0 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:32.694061 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-60d4e253-ba7c-42a4-81e7-ba0949d9a3f0 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:32.701042 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-60d4e253-ba7c-42a4-81e7-ba0949d9a3f0 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:32.956536 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-60d4e253-ba7c-42a4-81e7-ba0949d9a3f0 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:32.966705 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-60d4e253-ba7c-42a4-81e7-ba0949d9a3f0 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:32.968160 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-60d4e253-ba7c-42a4-81e7-ba0949d9a3f0 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:32.969621 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-60d4e253-ba7c-42a4-81e7-ba0949d9a3f0 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1723 microversion: 2.20 time: 0.289591 Jul 07 10:32:32.980855 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 336/693] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:32:32 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 10:32:33.095331 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-bb89275d-a815-48d7-a88d-02aa9bdaa123 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Flavor limits 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 10:32:33.096099 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-bb89275d-a815-48d7-a88d-02aa9bdaa123 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Image limits 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 10:32:33.096818 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-bb89275d-a815-48d7-a88d-02aa9bdaa123 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Flavor pref 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 10:32:33.097433 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-bb89275d-a815-48d7-a88d-02aa9bdaa123 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Image pref 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 10:32:33.097950 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-bb89275d-a815-48d7-a88d-02aa9bdaa123 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 10:32:33.109045 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bb89275d-a815-48d7-a88d-02aa9bdaa123 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:33.109496 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bb89275d-a815-48d7-a88d-02aa9bdaa123 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:33.110337 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bb89275d-a815-48d7-a88d-02aa9bdaa123 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:33.110779 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bb89275d-a815-48d7-a88d-02aa9bdaa123 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:33.130034 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-bb89275d-a815-48d7-a88d-02aa9bdaa123 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Getting quotas for project 12a91d56e163442dacf4c5ce7b28a132. Resources: {'cores', 'ram', 'instances'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:32:33.134154 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-bb89275d-a815-48d7-a88d-02aa9bdaa123 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Getting quotas for user 059a87a80fc547db8aeb3bb03003cd2c and project 12a91d56e163442dacf4c5ce7b28a132. Resources: {'cores', 'ram', 'instances'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:32:33.199128 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-bb89275d-a815-48d7-a88d-02aa9bdaa123 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Going to run 1 instances... {{(pid=117646) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 10:32:33.201279 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-bb89275d-a815-48d7-a88d-02aa9bdaa123 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 3e104062-e8e4-4102-8367-0cf2c09c97d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='faf59746-87c7-41ff-9011-1af885e44e0a',volume_size=None,volume_type=None)] {{(pid=117646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 10:32:33.296259 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-98f09284-76d7-4309-a010-cb777664b87b tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:33.296885 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-98f09284-76d7-4309-a010-cb777664b87b tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:33.308154 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-98f09284-76d7-4309-a010-cb777664b87b tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:33.308616 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-98f09284-76d7-4309-a010-cb777664b87b tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:33.309402 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-98f09284-76d7-4309-a010-cb777664b87b tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:33.309840 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-98f09284-76d7-4309-a010-cb777664b87b tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:33.367490 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-bb89275d-a815-48d7-a88d-02aa9bdaa123 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.819639 Jul 07 10:32:33.371180 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 358/694] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jul 7 10:32:32 2022] POST /compute/v2.1/servers => generated 404 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 10:32:33.380826 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-59273722-2d42-4a5b-bf05-3f84cc48b9d0 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:33.381557 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-59273722-2d42-4a5b-bf05-3f84cc48b9d0 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 3e104062-e8e4-4102-8367-0cf2c09c97d0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:33.458345 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-59273722-2d42-4a5b-bf05-3f84cc48b9d0 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:33.471623 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-59273722-2d42-4a5b-bf05-3f84cc48b9d0 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0" status: 200 len: 1093 microversion: 2.1 time: 0.094606 Jul 07 10:32:33.472776 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 359/695] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:33 2022] GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0 => generated 1093 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:32:33.528045 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-98f09284-76d7-4309-a010-cb777664b87b tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:33.535342 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-98f09284-76d7-4309-a010-cb777664b87b tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12" status: 200 len: 1367 microversion: 2.1 time: 0.244136 Jul 07 10:32:33.536444 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 337/696] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:33 2022] GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:32:33.987353 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-96198380-e159-495a-a0ab-56e77e807269 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:33.988048 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-96198380-e159-495a-a0ab-56e77e807269 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:33.995090 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-96198380-e159-495a-a0ab-56e77e807269 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:33.995905 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-96198380-e159-495a-a0ab-56e77e807269 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:33.996926 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-96198380-e159-495a-a0ab-56e77e807269 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:33.997587 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-96198380-e159-495a-a0ab-56e77e807269 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:34.097969 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-4d3800c6-fc70-4a51-8b18-76338955a056 req-828bfd69-4414-4009-a763-0140b37cff1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55b0ddaa-4b4a-4050-a95f-dea6e7754d12", "tag": "de9d78a0-ee28-42fd-97fe-b5ec1f75f48f"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:32:34.107697 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-4d3800c6-fc70-4a51-8b18-76338955a056 req-828bfd69-4414-4009-a763-0140b37cff1d service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:34.108327 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-4d3800c6-fc70-4a51-8b18-76338955a056 req-828bfd69-4414-4009-a763-0140b37cff1d service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:34.129376 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-4d3800c6-fc70-4a51-8b18-76338955a056 req-828bfd69-4414-4009-a763-0140b37cff1d service nova] Creating event network-changed:de9d78a0-ee28-42fd-97fe-b5ec1f75f48f for instance 55b0ddaa-4b4a-4050-a95f-dea6e7754d12 on hv-cinder-82282 Jul 07 10:32:34.134537 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-4d3800c6-fc70-4a51-8b18-76338955a056 req-828bfd69-4414-4009-a763-0140b37cff1d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041378 Jul 07 10:32:34.135135 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 338/697] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 10:32:34.158244 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-96198380-e159-495a-a0ab-56e77e807269 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:34.167084 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-96198380-e159-495a-a0ab-56e77e807269 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:34.168625 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-96198380-e159-495a-a0ab-56e77e807269 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:34.169808 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-96198380-e159-495a-a0ab-56e77e807269 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1723 microversion: 2.20 time: 0.186622 Jul 07 10:32:34.170439 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 360/698] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:32:33 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 10:32:34.489051 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-733fb233-a3d8-48f0-bbef-e21004c8a833 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:34.489933 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-733fb233-a3d8-48f0-bbef-e21004c8a833 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 3e104062-e8e4-4102-8367-0cf2c09c97d0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:34.497647 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-733fb233-a3d8-48f0-bbef-e21004c8a833 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:34.498325 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-733fb233-a3d8-48f0-bbef-e21004c8a833 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:34.499283 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-733fb233-a3d8-48f0-bbef-e21004c8a833 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:34.499905 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-733fb233-a3d8-48f0-bbef-e21004c8a833 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:34.552656 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a72415f9-2571-4df9-98cb-bdbab40d6e6e tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:34.553270 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-a72415f9-2571-4df9-98cb-bdbab40d6e6e tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:34.562055 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a72415f9-2571-4df9-98cb-bdbab40d6e6e tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:34.562509 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a72415f9-2571-4df9-98cb-bdbab40d6e6e tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:34.563499 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a72415f9-2571-4df9-98cb-bdbab40d6e6e tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:34.564124 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a72415f9-2571-4df9-98cb-bdbab40d6e6e tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:34.702391 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-a72415f9-2571-4df9-98cb-bdbab40d6e6e tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:34.710388 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-a72415f9-2571-4df9-98cb-bdbab40d6e6e tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12" status: 200 len: 1367 microversion: 2.1 time: 0.161489 Jul 07 10:32:34.711061 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 361/699] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:34 2022] GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:34.805093 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-733fb233-a3d8-48f0-bbef-e21004c8a833 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:34.812875 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-733fb233-a3d8-48f0-bbef-e21004c8a833 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0" status: 200 len: 1209 microversion: 2.1 time: 0.328714 Jul 07 10:32:34.813528 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 339/700] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:34 2022] GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0 => generated 1209 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:35.188178 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-1d9b7652-124e-4a76-9e15-7bc59e4c1b08 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:35.189114 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-1d9b7652-124e-4a76-9e15-7bc59e4c1b08 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:35.196138 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1d9b7652-124e-4a76-9e15-7bc59e4c1b08 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:35.196785 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1d9b7652-124e-4a76-9e15-7bc59e4c1b08 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:35.197560 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1d9b7652-124e-4a76-9e15-7bc59e4c1b08 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:35.197995 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1d9b7652-124e-4a76-9e15-7bc59e4c1b08 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:35.333709 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-1d9b7652-124e-4a76-9e15-7bc59e4c1b08 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:35.342735 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-1d9b7652-124e-4a76-9e15-7bc59e4c1b08 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:35.344310 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-1d9b7652-124e-4a76-9e15-7bc59e4c1b08 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:35.345495 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-1d9b7652-124e-4a76-9e15-7bc59e4c1b08 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1723 microversion: 2.20 time: 0.161304 Jul 07 10:32:35.356653 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 362/701] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:32:35 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:32:35.729026 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6aa5f8b1-99bc-41d0-aa63-d81136001d49 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:35.729792 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6aa5f8b1-99bc-41d0-aa63-d81136001d49 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:35.736735 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6aa5f8b1-99bc-41d0-aa63-d81136001d49 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:35.737190 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6aa5f8b1-99bc-41d0-aa63-d81136001d49 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:35.737971 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6aa5f8b1-99bc-41d0-aa63-d81136001d49 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:35.738411 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6aa5f8b1-99bc-41d0-aa63-d81136001d49 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:35.830873 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-2513dbde-cfc5-4ec6-a499-781b121d9774 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:35.831485 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-2513dbde-cfc5-4ec6-a499-781b121d9774 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 3e104062-e8e4-4102-8367-0cf2c09c97d0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:35.839053 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2513dbde-cfc5-4ec6-a499-781b121d9774 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:35.839506 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2513dbde-cfc5-4ec6-a499-781b121d9774 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:35.840514 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2513dbde-cfc5-4ec6-a499-781b121d9774 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:35.840959 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2513dbde-cfc5-4ec6-a499-781b121d9774 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:35.951829 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6aa5f8b1-99bc-41d0-aa63-d81136001d49 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:35.960368 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6aa5f8b1-99bc-41d0-aa63-d81136001d49 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12" status: 200 len: 1367 microversion: 2.1 time: 0.235910 Jul 07 10:32:35.961243 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 340/702] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:35 2022] GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:35.993088 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-2513dbde-cfc5-4ec6-a499-781b121d9774 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:36.000978 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-2513dbde-cfc5-4ec6-a499-781b121d9774 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0" status: 200 len: 1263 microversion: 2.1 time: 0.173990 Jul 07 10:32:36.007765 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 363/703] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:35 2022] GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0 => generated 1263 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:32:36.363381 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-346c48ee-a314-4aed-9b23-09e0fd9e423e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:36.364016 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-346c48ee-a314-4aed-9b23-09e0fd9e423e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:36.369959 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-346c48ee-a314-4aed-9b23-09e0fd9e423e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:36.370406 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-346c48ee-a314-4aed-9b23-09e0fd9e423e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:36.371151 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-346c48ee-a314-4aed-9b23-09e0fd9e423e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:36.371579 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-346c48ee-a314-4aed-9b23-09e0fd9e423e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:36.503179 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-346c48ee-a314-4aed-9b23-09e0fd9e423e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:36.511692 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-346c48ee-a314-4aed-9b23-09e0fd9e423e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:36.513303 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-346c48ee-a314-4aed-9b23-09e0fd9e423e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:36.514450 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-346c48ee-a314-4aed-9b23-09e0fd9e423e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1723 microversion: 2.20 time: 0.154959 Jul 07 10:32:36.515000 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 341/704] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:32:36 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:32:36.977906 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-33f386b4-e5dd-4e41-968d-4f69525d0252 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:36.978503 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-33f386b4-e5dd-4e41-968d-4f69525d0252 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:36.984839 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-33f386b4-e5dd-4e41-968d-4f69525d0252 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:36.985298 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-33f386b4-e5dd-4e41-968d-4f69525d0252 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:36.986079 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-33f386b4-e5dd-4e41-968d-4f69525d0252 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:36.986530 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-33f386b4-e5dd-4e41-968d-4f69525d0252 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:37.018736 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-f3238c40-4ad3-4c3c-b648-73f3e5e4d8e0 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:37.019330 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-f3238c40-4ad3-4c3c-b648-73f3e5e4d8e0 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 3e104062-e8e4-4102-8367-0cf2c09c97d0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:37.028661 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f3238c40-4ad3-4c3c-b648-73f3e5e4d8e0 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:37.029460 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f3238c40-4ad3-4c3c-b648-73f3e5e4d8e0 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:37.030397 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f3238c40-4ad3-4c3c-b648-73f3e5e4d8e0 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:37.030995 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f3238c40-4ad3-4c3c-b648-73f3e5e4d8e0 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:37.134358 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-33f386b4-e5dd-4e41-968d-4f69525d0252 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:37.143111 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-33f386b4-e5dd-4e41-968d-4f69525d0252 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12" status: 200 len: 1367 microversion: 2.1 time: 0.169517 Jul 07 10:32:37.144021 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 364/705] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:36 2022] GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:37.244704 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f3238c40-4ad3-4c3c-b648-73f3e5e4d8e0 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:37.252181 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-f3238c40-4ad3-4c3c-b648-73f3e5e4d8e0 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0" status: 200 len: 1263 microversion: 2.1 time: 0.237605 Jul 07 10:32:37.252746 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 342/706] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:37 2022] GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0 => generated 1263 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:32:37.360404 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-71501fb4-89e6-42e2-badb-58efc388ae84 req-b9a3759e-82da-4f4c-ac6d-debbf0c30163 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e104062-e8e4-4102-8367-0cf2c09c97d0", "tag": "216fec1b-d072-4901-a408-a796234144d0"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:32:37.382134 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-71501fb4-89e6-42e2-badb-58efc388ae84 req-b9a3759e-82da-4f4c-ac6d-debbf0c30163 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:37.383005 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-71501fb4-89e6-42e2-badb-58efc388ae84 req-b9a3759e-82da-4f4c-ac6d-debbf0c30163 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:37.395093 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-71501fb4-89e6-42e2-badb-58efc388ae84 req-b9a3759e-82da-4f4c-ac6d-debbf0c30163 service nova] Creating event network-changed:216fec1b-d072-4901-a408-a796234144d0 for instance 3e104062-e8e4-4102-8367-0cf2c09c97d0 on hv-cinder-82282 Jul 07 10:32:37.401078 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-71501fb4-89e6-42e2-badb-58efc388ae84 req-b9a3759e-82da-4f4c-ac6d-debbf0c30163 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045146 Jul 07 10:32:37.401993 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 365/707] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:32:37.532317 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5e4081bb-0859-479e-90fb-0bcd42b0009a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:37.532991 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5e4081bb-0859-479e-90fb-0bcd42b0009a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:37.539243 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5e4081bb-0859-479e-90fb-0bcd42b0009a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:37.540353 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5e4081bb-0859-479e-90fb-0bcd42b0009a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:37.541134 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5e4081bb-0859-479e-90fb-0bcd42b0009a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:37.541615 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5e4081bb-0859-479e-90fb-0bcd42b0009a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:37.743188 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5e4081bb-0859-479e-90fb-0bcd42b0009a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:37.751354 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5e4081bb-0859-479e-90fb-0bcd42b0009a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:37.752906 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5e4081bb-0859-479e-90fb-0bcd42b0009a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:37.754067 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5e4081bb-0859-479e-90fb-0bcd42b0009a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1723 microversion: 2.20 time: 0.225686 Jul 07 10:32:37.754628 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 343/708] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:32:37 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:32:38.161194 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-333535a3-a2f5-4b1b-8566-8681f2a7afe5 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:38.161894 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-333535a3-a2f5-4b1b-8566-8681f2a7afe5 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:38.168075 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-333535a3-a2f5-4b1b-8566-8681f2a7afe5 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:38.168531 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-333535a3-a2f5-4b1b-8566-8681f2a7afe5 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:38.169302 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-333535a3-a2f5-4b1b-8566-8681f2a7afe5 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:38.169744 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-333535a3-a2f5-4b1b-8566-8681f2a7afe5 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:38.268941 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4be51faf-788a-4b36-b096-4a31358f44b8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:38.269678 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-4be51faf-788a-4b36-b096-4a31358f44b8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 3e104062-e8e4-4102-8367-0cf2c09c97d0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:38.278097 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4be51faf-788a-4b36-b096-4a31358f44b8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:38.278557 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4be51faf-788a-4b36-b096-4a31358f44b8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:38.279343 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4be51faf-788a-4b36-b096-4a31358f44b8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:38.280193 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4be51faf-788a-4b36-b096-4a31358f44b8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:38.307104 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-333535a3-a2f5-4b1b-8566-8681f2a7afe5 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:38.315206 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-333535a3-a2f5-4b1b-8566-8681f2a7afe5 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12" status: 200 len: 1367 microversion: 2.1 time: 0.158684 Jul 07 10:32:38.315789 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 366/709] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:38 2022] GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:38.495434 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-4be51faf-788a-4b36-b096-4a31358f44b8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:38.510447 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-4be51faf-788a-4b36-b096-4a31358f44b8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0" status: 200 len: 1263 microversion: 2.1 time: 0.245284 Jul 07 10:32:38.511606 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 344/710] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:38 2022] GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0 => generated 1263 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:32:38.772551 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-4c9239cd-4334-4c54-8028-90e32008870b tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:38.773153 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-4c9239cd-4334-4c54-8028-90e32008870b tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:38.779634 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4c9239cd-4334-4c54-8028-90e32008870b tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:38.780123 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4c9239cd-4334-4c54-8028-90e32008870b tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:38.780875 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4c9239cd-4334-4c54-8028-90e32008870b tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:38.781306 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4c9239cd-4334-4c54-8028-90e32008870b tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:38.913512 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-4c9239cd-4334-4c54-8028-90e32008870b tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:38.922354 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-4c9239cd-4334-4c54-8028-90e32008870b tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:38.923896 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-4c9239cd-4334-4c54-8028-90e32008870b tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:38.925074 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-4c9239cd-4334-4c54-8028-90e32008870b tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1723 microversion: 2.20 time: 0.156454 Jul 07 10:32:38.925634 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 367/711] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:32:38 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:32:39.332294 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-100fa795-a8dc-4ad6-a128-9be3159394d2 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:39.332912 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-100fa795-a8dc-4ad6-a128-9be3159394d2 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:39.339663 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-100fa795-a8dc-4ad6-a128-9be3159394d2 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:39.340989 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-100fa795-a8dc-4ad6-a128-9be3159394d2 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:39.341797 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-100fa795-a8dc-4ad6-a128-9be3159394d2 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:39.342242 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-100fa795-a8dc-4ad6-a128-9be3159394d2 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:39.479370 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-100fa795-a8dc-4ad6-a128-9be3159394d2 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:39.487207 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-100fa795-a8dc-4ad6-a128-9be3159394d2 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12" status: 200 len: 1367 microversion: 2.1 time: 0.158764 Jul 07 10:32:39.487804 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 345/712] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:39 2022] GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:39.529526 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-4be931e5-7e56-4738-9277-9a7a9b9092fc tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:39.530149 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-4be931e5-7e56-4738-9277-9a7a9b9092fc tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 3e104062-e8e4-4102-8367-0cf2c09c97d0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:39.536727 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4be931e5-7e56-4738-9277-9a7a9b9092fc tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:39.537185 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4be931e5-7e56-4738-9277-9a7a9b9092fc tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:39.537981 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4be931e5-7e56-4738-9277-9a7a9b9092fc tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:39.538425 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4be931e5-7e56-4738-9277-9a7a9b9092fc tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:39.671128 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-4be931e5-7e56-4738-9277-9a7a9b9092fc tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:39.674615 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:32:39.679344 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-4be931e5-7e56-4738-9277-9a7a9b9092fc tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0" status: 200 len: 1263 microversion: 2.1 time: 0.156871 Jul 07 10:32:39.680053 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 368/713] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:39 2022] GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:39.942311 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-fd270296-70f6-438a-ab35-c3abe298f645 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:39.943111 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-fd270296-70f6-438a-ab35-c3abe298f645 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:39.949544 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fd270296-70f6-438a-ab35-c3abe298f645 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:39.949988 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fd270296-70f6-438a-ab35-c3abe298f645 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:39.950744 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fd270296-70f6-438a-ab35-c3abe298f645 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:39.951174 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fd270296-70f6-438a-ab35-c3abe298f645 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:40.075456 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-fd270296-70f6-438a-ab35-c3abe298f645 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:40.083346 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-fd270296-70f6-438a-ab35-c3abe298f645 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:40.084903 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-fd270296-70f6-438a-ab35-c3abe298f645 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:40.086170 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-fd270296-70f6-438a-ab35-c3abe298f645 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1723 microversion: 2.20 time: 0.147751 Jul 07 10:32:40.087257 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 346/714] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:32:39 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:32:40.504824 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-bfec3d26-d8d0-437e-a79a-d21001d5b491 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:40.505441 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-bfec3d26-d8d0-437e-a79a-d21001d5b491 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:40.513022 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bfec3d26-d8d0-437e-a79a-d21001d5b491 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:40.513387 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bfec3d26-d8d0-437e-a79a-d21001d5b491 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:40.514432 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bfec3d26-d8d0-437e-a79a-d21001d5b491 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:40.514865 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bfec3d26-d8d0-437e-a79a-d21001d5b491 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:40.534936 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-52af6f73-ba27-466d-a98a-5bdec7d7fe84 req-a74a5e02-608c-46a0-a36a-c3e19524a02c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55b0ddaa-4b4a-4050-a95f-dea6e7754d12", "name": "network-vif-plugged", "status": "completed", "tag": "de9d78a0-ee28-42fd-97fe-b5ec1f75f48f"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:32:40.545884 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-52af6f73-ba27-466d-a98a-5bdec7d7fe84 req-a74a5e02-608c-46a0-a36a-c3e19524a02c service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:40.546552 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-52af6f73-ba27-466d-a98a-5bdec7d7fe84 req-a74a5e02-608c-46a0-a36a-c3e19524a02c service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:40.560234 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-52af6f73-ba27-466d-a98a-5bdec7d7fe84 req-a74a5e02-608c-46a0-a36a-c3e19524a02c service nova] Creating event network-vif-plugged:de9d78a0-ee28-42fd-97fe-b5ec1f75f48f for instance 55b0ddaa-4b4a-4050-a95f-dea6e7754d12 on hv-cinder-82282 Jul 07 10:32:40.577638 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-52af6f73-ba27-466d-a98a-5bdec7d7fe84 req-a74a5e02-608c-46a0-a36a-c3e19524a02c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046293 Jul 07 10:32:40.578660 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 347/715] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 10:32:40.698715 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1c1e8639-c61c-4d3f-a177-57d15609fc29 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:40.699371 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1c1e8639-c61c-4d3f-a177-57d15609fc29 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 3e104062-e8e4-4102-8367-0cf2c09c97d0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:40.706009 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1c1e8639-c61c-4d3f-a177-57d15609fc29 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:40.706457 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1c1e8639-c61c-4d3f-a177-57d15609fc29 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:40.707233 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1c1e8639-c61c-4d3f-a177-57d15609fc29 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:40.707672 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1c1e8639-c61c-4d3f-a177-57d15609fc29 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:40.886099 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-1c1e8639-c61c-4d3f-a177-57d15609fc29 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:40.891135 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-bfec3d26-d8d0-437e-a79a-d21001d5b491 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:40.893879 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1c1e8639-c61c-4d3f-a177-57d15609fc29 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0" status: 200 len: 1263 microversion: 2.1 time: 0.201026 Jul 07 10:32:40.894924 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 348/716] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:40 2022] GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0 => generated 1263 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:32:40.898467 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-bfec3d26-d8d0-437e-a79a-d21001d5b491 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12" status: 200 len: 1367 microversion: 2.1 time: 0.398790 Jul 07 10:32:40.899608 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 369/717] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:40 2022] GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12 => generated 1367 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:41.104555 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9f9ee5a4-7ffd-47a1-8699-9b0b0f97fd39 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:41.105165 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-9f9ee5a4-7ffd-47a1-8699-9b0b0f97fd39 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:41.107063 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:32:41.112602 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9f9ee5a4-7ffd-47a1-8699-9b0b0f97fd39 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:41.113054 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9f9ee5a4-7ffd-47a1-8699-9b0b0f97fd39 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:41.113817 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9f9ee5a4-7ffd-47a1-8699-9b0b0f97fd39 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:41.114252 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9f9ee5a4-7ffd-47a1-8699-9b0b0f97fd39 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:41.150854 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=8 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:32:41.240880 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9f9ee5a4-7ffd-47a1-8699-9b0b0f97fd39 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:41.249374 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9f9ee5a4-7ffd-47a1-8699-9b0b0f97fd39 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:41.250892 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9f9ee5a4-7ffd-47a1-8699-9b0b0f97fd39 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:41.252099 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9f9ee5a4-7ffd-47a1-8699-9b0b0f97fd39 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1723 microversion: 2.20 time: 0.151444 Jul 07 10:32:41.252660 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 349/718] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:32:41 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:32:41.910802 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-09591693-04d6-4843-bc1b-34457d6979e9 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:41.911318 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-09591693-04d6-4843-bc1b-34457d6979e9 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 3e104062-e8e4-4102-8367-0cf2c09c97d0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:41.915944 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-30d3fee4-cc4a-4d89-9662-19b223026c7a tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:41.916568 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-30d3fee4-cc4a-4d89-9662-19b223026c7a tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:41.918428 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-09591693-04d6-4843-bc1b-34457d6979e9 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:41.918880 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-09591693-04d6-4843-bc1b-34457d6979e9 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:41.919648 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-09591693-04d6-4843-bc1b-34457d6979e9 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:41.920136 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-09591693-04d6-4843-bc1b-34457d6979e9 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:41.922957 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-30d3fee4-cc4a-4d89-9662-19b223026c7a tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:41.923412 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-30d3fee4-cc4a-4d89-9662-19b223026c7a tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:41.924217 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-30d3fee4-cc4a-4d89-9662-19b223026c7a tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:41.924657 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-30d3fee4-cc4a-4d89-9662-19b223026c7a tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:41.928612 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=100 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:32:42.063504 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-09591693-04d6-4843-bc1b-34457d6979e9 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:42.073621 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-09591693-04d6-4843-bc1b-34457d6979e9 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0" status: 200 len: 1263 microversion: 2.1 time: 0.166663 Jul 07 10:32:42.074199 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 370/719] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:41 2022] GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0 => generated 1263 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:42.074624 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-30d3fee4-cc4a-4d89-9662-19b223026c7a tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:42.082022 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-30d3fee4-cc4a-4d89-9662-19b223026c7a tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12" status: 200 len: 1367 microversion: 2.1 time: 0.170540 Jul 07 10:32:42.082574 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 350/720] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:41 2022] GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:32:42.270452 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-02aa9c65-1187-4556-ac7d-080329c7efea tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:42.271012 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-02aa9c65-1187-4556-ac7d-080329c7efea tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:42.277561 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-02aa9c65-1187-4556-ac7d-080329c7efea tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:42.278008 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-02aa9c65-1187-4556-ac7d-080329c7efea tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:42.278761 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-02aa9c65-1187-4556-ac7d-080329c7efea tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:42.279190 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-02aa9c65-1187-4556-ac7d-080329c7efea tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:42.409906 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-02aa9c65-1187-4556-ac7d-080329c7efea tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:42.417694 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-02aa9c65-1187-4556-ac7d-080329c7efea tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:42.419184 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-02aa9c65-1187-4556-ac7d-080329c7efea tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:42.420370 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-02aa9c65-1187-4556-ac7d-080329c7efea tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1744 microversion: 2.20 time: 0.153912 Jul 07 10:32:42.420928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 371/721] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:32:42 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:32:43.090889 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ad91db8e-dbc8-48a9-952e-a44ad17f8816 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:43.091499 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ad91db8e-dbc8-48a9-952e-a44ad17f8816 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 3e104062-e8e4-4102-8367-0cf2c09c97d0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:43.098066 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ad91db8e-dbc8-48a9-952e-a44ad17f8816 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:43.098256 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-2b169e15-652c-48cd-9a4b-0eee7a426d3a tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:43.098668 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ad91db8e-dbc8-48a9-952e-a44ad17f8816 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:43.098768 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-2b169e15-652c-48cd-9a4b-0eee7a426d3a tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:43.099264 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ad91db8e-dbc8-48a9-952e-a44ad17f8816 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:43.099695 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ad91db8e-dbc8-48a9-952e-a44ad17f8816 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:43.105229 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2b169e15-652c-48cd-9a4b-0eee7a426d3a tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:43.105693 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2b169e15-652c-48cd-9a4b-0eee7a426d3a tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:43.106451 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2b169e15-652c-48cd-9a4b-0eee7a426d3a tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:43.106885 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2b169e15-652c-48cd-9a4b-0eee7a426d3a tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:43.121543 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell0:SELECT=2 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:32:43.229692 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ad91db8e-dbc8-48a9-952e-a44ad17f8816 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:43.235654 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-2b169e15-652c-48cd-9a4b-0eee7a426d3a tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:43.237159 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ad91db8e-dbc8-48a9-952e-a44ad17f8816 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0" status: 200 len: 1263 microversion: 2.1 time: 0.150772 Jul 07 10:32:43.237819 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 351/722] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:43 2022] GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:43.243678 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-2b169e15-652c-48cd-9a4b-0eee7a426d3a tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12" status: 200 len: 1557 microversion: 2.1 time: 0.149363 Jul 07 10:32:43.244270 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 372/723] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:43 2022] GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:32:43.259983 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d0be23a0-3fc4-4be2-bd70-91366ee6d500 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:43.260479 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d0be23a0-3fc4-4be2-bd70-91366ee6d500 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:43.266472 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d0be23a0-3fc4-4be2-bd70-91366ee6d500 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:43.266923 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d0be23a0-3fc4-4be2-bd70-91366ee6d500 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:43.267684 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d0be23a0-3fc4-4be2-bd70-91366ee6d500 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:43.268156 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d0be23a0-3fc4-4be2-bd70-91366ee6d500 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:43.342595 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d0be23a0-3fc4-4be2-bd70-91366ee6d500 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.086843 Jul 07 10:32:43.343135 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 352/724] 10.222.0.16 () {58 vars in 1274 bytes} [Thu Jul 7 10:32:43 2022] GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 10:32:43.438409 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-cd90ac2b-ad8a-46fa-b2a3-d5d2b34268d4 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:43.439011 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-cd90ac2b-ad8a-46fa-b2a3-d5d2b34268d4 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:43.445336 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-cd90ac2b-ad8a-46fa-b2a3-d5d2b34268d4 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:43.446298 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-cd90ac2b-ad8a-46fa-b2a3-d5d2b34268d4 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:43.447059 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-cd90ac2b-ad8a-46fa-b2a3-d5d2b34268d4 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:43.447971 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-cd90ac2b-ad8a-46fa-b2a3-d5d2b34268d4 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:43.465144 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell0:SELECT=12 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:32:43.580222 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-cd90ac2b-ad8a-46fa-b2a3-d5d2b34268d4 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:43.588243 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-cd90ac2b-ad8a-46fa-b2a3-d5d2b34268d4 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:43.589758 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-cd90ac2b-ad8a-46fa-b2a3-d5d2b34268d4 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:43.590953 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-cd90ac2b-ad8a-46fa-b2a3-d5d2b34268d4 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1744 microversion: 2.20 time: 0.156483 Jul 07 10:32:43.591705 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 373/725] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:32:43 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:32:44.254854 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-593f949e-bee1-424d-8ab9-987867914014 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:44.255472 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-593f949e-bee1-424d-8ab9-987867914014 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 3e104062-e8e4-4102-8367-0cf2c09c97d0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:44.261518 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-593f949e-bee1-424d-8ab9-987867914014 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:44.261976 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-593f949e-bee1-424d-8ab9-987867914014 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:44.262741 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-593f949e-bee1-424d-8ab9-987867914014 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:44.263177 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-593f949e-bee1-424d-8ab9-987867914014 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:44.451625 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-593f949e-bee1-424d-8ab9-987867914014 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:44.459663 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-593f949e-bee1-424d-8ab9-987867914014 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0" status: 200 len: 1263 microversion: 2.1 time: 0.209193 Jul 07 10:32:44.460556 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 353/726] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:44 2022] GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0 => generated 1263 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:44.605281 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-79f3b3e6-b45d-4027-8d3c-566b3075ff8d req-18d0006e-2a7d-42f2-ab89-4d39105befcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55b0ddaa-4b4a-4050-a95f-dea6e7754d12", "tag": "de9d78a0-ee28-42fd-97fe-b5ec1f75f48f"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:32:44.610569 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-199501c2-fb62-42be-81ca-ebd8aaad763d tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:44.611221 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-199501c2-fb62-42be-81ca-ebd8aaad763d tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:44.616873 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-79f3b3e6-b45d-4027-8d3c-566b3075ff8d req-18d0006e-2a7d-42f2-ab89-4d39105befcc service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:44.617592 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-79f3b3e6-b45d-4027-8d3c-566b3075ff8d req-18d0006e-2a7d-42f2-ab89-4d39105befcc service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:44.618138 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-199501c2-fb62-42be-81ca-ebd8aaad763d tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:44.618643 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-199501c2-fb62-42be-81ca-ebd8aaad763d tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:44.619417 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-199501c2-fb62-42be-81ca-ebd8aaad763d tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:44.619882 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-199501c2-fb62-42be-81ca-ebd8aaad763d tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:44.630886 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-79f3b3e6-b45d-4027-8d3c-566b3075ff8d req-18d0006e-2a7d-42f2-ab89-4d39105befcc service nova] Creating event network-changed:de9d78a0-ee28-42fd-97fe-b5ec1f75f48f for instance 55b0ddaa-4b4a-4050-a95f-dea6e7754d12 on hv-cinder-82282 Jul 07 10:32:44.637068 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-79f3b3e6-b45d-4027-8d3c-566b3075ff8d req-18d0006e-2a7d-42f2-ab89-4d39105befcc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037203 Jul 07 10:32:44.638330 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 374/727] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:32:44.842616 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-199501c2-fb62-42be-81ca-ebd8aaad763d tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:44.850589 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-199501c2-fb62-42be-81ca-ebd8aaad763d tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:44.852186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-199501c2-fb62-42be-81ca-ebd8aaad763d tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:44.853325 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-199501c2-fb62-42be-81ca-ebd8aaad763d tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1739 microversion: 2.20 time: 0.248010 Jul 07 10:32:44.864736 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 354/728] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:32:44 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1739 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:32:45.478455 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-f5530d15-6e97-4208-aa08-206a021f3b19 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:45.479312 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-f5530d15-6e97-4208-aa08-206a021f3b19 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 3e104062-e8e4-4102-8367-0cf2c09c97d0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:45.494866 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f5530d15-6e97-4208-aa08-206a021f3b19 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:45.495780 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f5530d15-6e97-4208-aa08-206a021f3b19 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:45.496778 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f5530d15-6e97-4208-aa08-206a021f3b19 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:45.497446 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f5530d15-6e97-4208-aa08-206a021f3b19 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:45.707951 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-f5530d15-6e97-4208-aa08-206a021f3b19 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:45.718160 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-f5530d15-6e97-4208-aa08-206a021f3b19 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0" status: 200 len: 1263 microversion: 2.1 time: 0.244981 Jul 07 10:32:45.728612 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 375/729] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:45 2022] GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0 => generated 1263 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:45.870866 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ac6698a9-467e-4854-a3c8-8933ca957755 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:45.871695 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ac6698a9-467e-4854-a3c8-8933ca957755 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:45.880247 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ac6698a9-467e-4854-a3c8-8933ca957755 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:45.880806 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ac6698a9-467e-4854-a3c8-8933ca957755 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:45.881903 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ac6698a9-467e-4854-a3c8-8933ca957755 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:45.882423 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ac6698a9-467e-4854-a3c8-8933ca957755 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:46.046765 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ac6698a9-467e-4854-a3c8-8933ca957755 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:46.068464 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ac6698a9-467e-4854-a3c8-8933ca957755 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:46.070801 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ac6698a9-467e-4854-a3c8-8933ca957755 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:46.072053 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ac6698a9-467e-4854-a3c8-8933ca957755 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1739 microversion: 2.20 time: 0.205516 Jul 07 10:32:46.073110 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 355/730] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:32:45 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:32:46.718837 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-936a9082-944f-4938-8cbb-015ed68984d9 req-dd8c9775-2a1c-47ef-9a21-63376e5b31a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b52e1947-1b4e-4a83-9041-ea3b84be027f", "name": "network-vif-plugged", "status": "completed", "tag": "ec13cec0-c49a-4b4e-b223-9bc0ab7b4152"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:32:46.736351 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-936a9082-944f-4938-8cbb-015ed68984d9 req-dd8c9775-2a1c-47ef-9a21-63376e5b31a4 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:46.737786 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-936a9082-944f-4938-8cbb-015ed68984d9 req-dd8c9775-2a1c-47ef-9a21-63376e5b31a4 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:46.738511 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-83affee0-bc4f-452c-8604-47d685fac294 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:46.739597 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-83affee0-bc4f-452c-8604-47d685fac294 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 3e104062-e8e4-4102-8367-0cf2c09c97d0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:46.753686 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-83affee0-bc4f-452c-8604-47d685fac294 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:46.754144 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-83affee0-bc4f-452c-8604-47d685fac294 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:46.754687 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-936a9082-944f-4938-8cbb-015ed68984d9 req-dd8c9775-2a1c-47ef-9a21-63376e5b31a4 service nova] Creating event network-vif-plugged:ec13cec0-c49a-4b4e-b223-9bc0ab7b4152 for instance b52e1947-1b4e-4a83-9041-ea3b84be027f on hv-cinder-82282 Jul 07 10:32:46.754924 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-83affee0-bc4f-452c-8604-47d685fac294 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:46.756607 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-83affee0-bc4f-452c-8604-47d685fac294 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:46.763183 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-936a9082-944f-4938-8cbb-015ed68984d9 req-dd8c9775-2a1c-47ef-9a21-63376e5b31a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046921 Jul 07 10:32:46.764169 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 376/731] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:32:46.911125 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-83affee0-bc4f-452c-8604-47d685fac294 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:46.921090 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-83affee0-bc4f-452c-8604-47d685fac294 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0" status: 200 len: 1263 microversion: 2.1 time: 0.188644 Jul 07 10:32:46.922238 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 356/732] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:46 2022] GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0 => generated 1263 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:47.093068 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-02ee4258-7f1e-4f80-a0a1-7eecd7594e39 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:47.094028 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-02ee4258-7f1e-4f80-a0a1-7eecd7594e39 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:47.104050 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-02ee4258-7f1e-4f80-a0a1-7eecd7594e39 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:47.104874 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-02ee4258-7f1e-4f80-a0a1-7eecd7594e39 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:47.108263 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-02ee4258-7f1e-4f80-a0a1-7eecd7594e39 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:47.109056 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-02ee4258-7f1e-4f80-a0a1-7eecd7594e39 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:47.290406 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-02ee4258-7f1e-4f80-a0a1-7eecd7594e39 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:47.299847 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-02ee4258-7f1e-4f80-a0a1-7eecd7594e39 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:47.302330 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-02ee4258-7f1e-4f80-a0a1-7eecd7594e39 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:47.303904 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-02ee4258-7f1e-4f80-a0a1-7eecd7594e39 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1739 microversion: 2.20 time: 0.216016 Jul 07 10:32:47.316536 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 377/733] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:32:47 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1739 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:32:47.944135 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-fa852325-b368-4b10-8f6c-0a19c025bdc8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:47.945806 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-fa852325-b368-4b10-8f6c-0a19c025bdc8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 3e104062-e8e4-4102-8367-0cf2c09c97d0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:47.953312 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fa852325-b368-4b10-8f6c-0a19c025bdc8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:47.953782 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fa852325-b368-4b10-8f6c-0a19c025bdc8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:47.954582 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fa852325-b368-4b10-8f6c-0a19c025bdc8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:47.955027 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fa852325-b368-4b10-8f6c-0a19c025bdc8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:48.099770 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-fa852325-b368-4b10-8f6c-0a19c025bdc8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:48.108768 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-fa852325-b368-4b10-8f6c-0a19c025bdc8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0" status: 200 len: 1263 microversion: 2.1 time: 0.173810 Jul 07 10:32:48.109566 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 357/734] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:47 2022] GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0 => generated 1263 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:48.322379 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-0be262f6-318a-4e65-a7e2-1635b616db0f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:48.323585 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-0be262f6-318a-4e65-a7e2-1635b616db0f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:48.330169 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0be262f6-318a-4e65-a7e2-1635b616db0f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:48.330819 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0be262f6-318a-4e65-a7e2-1635b616db0f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:48.333081 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0be262f6-318a-4e65-a7e2-1635b616db0f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:48.334377 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0be262f6-318a-4e65-a7e2-1635b616db0f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:48.494934 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-0be262f6-318a-4e65-a7e2-1635b616db0f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:48.519956 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-0be262f6-318a-4e65-a7e2-1635b616db0f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:48.524725 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-0be262f6-318a-4e65-a7e2-1635b616db0f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:48.526746 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-0be262f6-318a-4e65-a7e2-1635b616db0f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1739 microversion: 2.20 time: 0.208174 Jul 07 10:32:48.539978 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 378/735] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:32:48 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1739 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:32:48.786651 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-f38a81a2-5d89-4163-be60-3bc0ed2d5772 req-9bbc9397-bddf-4ef8-9976-20671b870685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e104062-e8e4-4102-8367-0cf2c09c97d0", "name": "network-vif-plugged", "status": "completed", "tag": "216fec1b-d072-4901-a408-a796234144d0"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:32:48.798514 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-f38a81a2-5d89-4163-be60-3bc0ed2d5772 req-9bbc9397-bddf-4ef8-9976-20671b870685 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:48.798965 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-f38a81a2-5d89-4163-be60-3bc0ed2d5772 req-9bbc9397-bddf-4ef8-9976-20671b870685 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:48.812000 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-f38a81a2-5d89-4163-be60-3bc0ed2d5772 req-9bbc9397-bddf-4ef8-9976-20671b870685 service nova] Creating event network-vif-plugged:216fec1b-d072-4901-a408-a796234144d0 for instance 3e104062-e8e4-4102-8367-0cf2c09c97d0 on hv-cinder-82282 Jul 07 10:32:48.817210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-f38a81a2-5d89-4163-be60-3bc0ed2d5772 req-9bbc9397-bddf-4ef8-9976-20671b870685 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034309 Jul 07 10:32:48.818304 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 358/736] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:32:49.130180 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a4d002af-4bbc-4888-94d9-5e873e75c924 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:49.134241 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-a4d002af-4bbc-4888-94d9-5e873e75c924 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 3e104062-e8e4-4102-8367-0cf2c09c97d0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:49.141708 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a4d002af-4bbc-4888-94d9-5e873e75c924 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:49.142407 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a4d002af-4bbc-4888-94d9-5e873e75c924 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:49.143195 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a4d002af-4bbc-4888-94d9-5e873e75c924 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:49.143638 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a4d002af-4bbc-4888-94d9-5e873e75c924 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:49.305643 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-a4d002af-4bbc-4888-94d9-5e873e75c924 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:49.313775 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-a4d002af-4bbc-4888-94d9-5e873e75c924 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0" status: 200 len: 1263 microversion: 2.1 time: 0.191278 Jul 07 10:32:49.314610 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 379/737] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:49 2022] GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0 => generated 1263 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:49.549440 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b18f6449-d3e3-4562-ad00-e88ec0f04627 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:49.550446 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b18f6449-d3e3-4562-ad00-e88ec0f04627 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:49.557768 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b18f6449-d3e3-4562-ad00-e88ec0f04627 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:49.558221 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b18f6449-d3e3-4562-ad00-e88ec0f04627 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:49.559316 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b18f6449-d3e3-4562-ad00-e88ec0f04627 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:49.559779 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b18f6449-d3e3-4562-ad00-e88ec0f04627 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:49.728160 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b18f6449-d3e3-4562-ad00-e88ec0f04627 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:49.738479 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b18f6449-d3e3-4562-ad00-e88ec0f04627 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:49.740018 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b18f6449-d3e3-4562-ad00-e88ec0f04627 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:49.741212 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b18f6449-d3e3-4562-ad00-e88ec0f04627 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1739 microversion: 2.20 time: 0.199209 Jul 07 10:32:49.743777 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 359/738] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:32:49 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:32:50.333366 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-93508674-3165-4b4d-bb3b-23c57ef2cd47 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:50.334694 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-93508674-3165-4b4d-bb3b-23c57ef2cd47 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 3e104062-e8e4-4102-8367-0cf2c09c97d0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:50.342786 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-93508674-3165-4b4d-bb3b-23c57ef2cd47 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:50.343465 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-93508674-3165-4b4d-bb3b-23c57ef2cd47 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:50.344370 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-93508674-3165-4b4d-bb3b-23c57ef2cd47 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:50.344977 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-93508674-3165-4b4d-bb3b-23c57ef2cd47 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:50.486321 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-93508674-3165-4b4d-bb3b-23c57ef2cd47 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:50.502020 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-93508674-3165-4b4d-bb3b-23c57ef2cd47 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0" status: 200 len: 1451 microversion: 2.1 time: 0.172397 Jul 07 10:32:50.502845 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 380/739] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:50 2022] GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0 => generated 1451 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:50.519487 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c8a9a01a-102b-4ed3-ab4b-e9e60093e053 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:50.520126 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c8a9a01a-102b-4ed3-ab4b-e9e60093e053 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 3e104062-e8e4-4102-8367-0cf2c09c97d0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:50.522582 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:32:50.528396 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c8a9a01a-102b-4ed3-ab4b-e9e60093e053 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:50.528851 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c8a9a01a-102b-4ed3-ab4b-e9e60093e053 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:50.529649 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c8a9a01a-102b-4ed3-ab4b-e9e60093e053 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:50.530089 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c8a9a01a-102b-4ed3-ab4b-e9e60093e053 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:50.702266 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c8a9a01a-102b-4ed3-ab4b-e9e60093e053 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:50.711173 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c8a9a01a-102b-4ed3-ab4b-e9e60093e053 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0" status: 200 len: 1451 microversion: 2.1 time: 0.195156 Jul 07 10:32:50.711962 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 360/740] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:32:50 2022] GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0 => generated 1451 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:32:50.760340 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-8c63ee3d-3bc5-4706-aefd-b55de51e3140 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:50.761343 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-8c63ee3d-3bc5-4706-aefd-b55de51e3140 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:50.771618 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8c63ee3d-3bc5-4706-aefd-b55de51e3140 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:50.772134 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8c63ee3d-3bc5-4706-aefd-b55de51e3140 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:50.773450 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8c63ee3d-3bc5-4706-aefd-b55de51e3140 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:50.774067 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8c63ee3d-3bc5-4706-aefd-b55de51e3140 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:50.920917 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-8c63ee3d-3bc5-4706-aefd-b55de51e3140 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:50.931418 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-8c63ee3d-3bc5-4706-aefd-b55de51e3140 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:50.933263 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-8c63ee3d-3bc5-4706-aefd-b55de51e3140 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:50.934702 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-8c63ee3d-3bc5-4706-aefd-b55de51e3140 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1739 microversion: 2.20 time: 0.180206 Jul 07 10:32:50.935828 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 381/741] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:32:50 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:32:51.954057 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4a0f4bed-de6e-4767-9acb-90e58bd46443 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:51.955385 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-4a0f4bed-de6e-4767-9acb-90e58bd46443 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:51.963159 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4a0f4bed-de6e-4767-9acb-90e58bd46443 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:51.964217 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4a0f4bed-de6e-4767-9acb-90e58bd46443 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:51.965217 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4a0f4bed-de6e-4767-9acb-90e58bd46443 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:51.965969 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4a0f4bed-de6e-4767-9acb-90e58bd46443 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:52.272906 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-4a0f4bed-de6e-4767-9acb-90e58bd46443 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:52.282390 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-4a0f4bed-de6e-4767-9acb-90e58bd46443 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:52.286980 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-4a0f4bed-de6e-4767-9acb-90e58bd46443 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:52.288514 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-4a0f4bed-de6e-4767-9acb-90e58bd46443 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1739 microversion: 2.20 time: 0.339480 Jul 07 10:32:52.299500 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 361/742] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:32:51 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1739 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:32:52.770924 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-b6585855-d36d-42b8-989d-2946cd4a573d req-f592528d-0d17-4000-ba7d-fefa65c76ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e104062-e8e4-4102-8367-0cf2c09c97d0", "tag": "216fec1b-d072-4901-a408-a796234144d0"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:32:52.779968 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-b6585855-d36d-42b8-989d-2946cd4a573d req-f592528d-0d17-4000-ba7d-fefa65c76ad9 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:52.780182 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-b6585855-d36d-42b8-989d-2946cd4a573d req-f592528d-0d17-4000-ba7d-fefa65c76ad9 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:52.792815 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-b6585855-d36d-42b8-989d-2946cd4a573d req-f592528d-0d17-4000-ba7d-fefa65c76ad9 service nova] Creating event network-changed:216fec1b-d072-4901-a408-a796234144d0 for instance 3e104062-e8e4-4102-8367-0cf2c09c97d0 on hv-cinder-82282 Jul 07 10:32:52.798636 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-b6585855-d36d-42b8-989d-2946cd4a573d req-f592528d-0d17-4000-ba7d-fefa65c76ad9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031135 Jul 07 10:32:52.799295 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 382/743] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:32:53.308016 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0c1e0095-78a8-450c-b6ab-2953a5060c94 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:53.309343 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0c1e0095-78a8-450c-b6ab-2953a5060c94 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:53.321511 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0c1e0095-78a8-450c-b6ab-2953a5060c94 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:53.322356 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0c1e0095-78a8-450c-b6ab-2953a5060c94 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:53.326169 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0c1e0095-78a8-450c-b6ab-2953a5060c94 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:53.329327 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0c1e0095-78a8-450c-b6ab-2953a5060c94 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:53.589475 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0c1e0095-78a8-450c-b6ab-2953a5060c94 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:53.599166 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0c1e0095-78a8-450c-b6ab-2953a5060c94 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:53.600699 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0c1e0095-78a8-450c-b6ab-2953a5060c94 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:53.601900 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0c1e0095-78a8-450c-b6ab-2953a5060c94 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1739 microversion: 2.20 time: 0.299273 Jul 07 10:32:53.612599 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 362/744] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:32:53 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1739 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:32:54.620916 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-bf0a29f3-67b1-49f8-b43f-f89ee39b59b7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:54.621607 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-bf0a29f3-67b1-49f8-b43f-f89ee39b59b7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:54.627837 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bf0a29f3-67b1-49f8-b43f-f89ee39b59b7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:54.628289 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bf0a29f3-67b1-49f8-b43f-f89ee39b59b7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:54.629049 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bf0a29f3-67b1-49f8-b43f-f89ee39b59b7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:54.629484 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bf0a29f3-67b1-49f8-b43f-f89ee39b59b7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:54.756668 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-bf0a29f3-67b1-49f8-b43f-f89ee39b59b7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:54.764629 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-bf0a29f3-67b1-49f8-b43f-f89ee39b59b7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:54.766138 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-bf0a29f3-67b1-49f8-b43f-f89ee39b59b7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:54.767297 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-bf0a29f3-67b1-49f8-b43f-f89ee39b59b7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1739 microversion: 2.20 time: 0.151313 Jul 07 10:32:54.768009 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 383/745] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:32:54 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:32:55.787873 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b34d605d-57ed-4b94-8382-ad39e5a5c173 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:55.788464 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b34d605d-57ed-4b94-8382-ad39e5a5c173 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:55.795101 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b34d605d-57ed-4b94-8382-ad39e5a5c173 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:55.795548 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b34d605d-57ed-4b94-8382-ad39e5a5c173 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:55.796338 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b34d605d-57ed-4b94-8382-ad39e5a5c173 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:55.796769 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b34d605d-57ed-4b94-8382-ad39e5a5c173 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:55.926514 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b34d605d-57ed-4b94-8382-ad39e5a5c173 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:55.934767 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b34d605d-57ed-4b94-8382-ad39e5a5c173 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:55.936282 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b34d605d-57ed-4b94-8382-ad39e5a5c173 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:55.937437 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b34d605d-57ed-4b94-8382-ad39e5a5c173 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1721 microversion: 2.20 time: 0.153502 Jul 07 10:32:55.937986 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 363/746] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:32:55 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:32:56.956479 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-9274f555-cfae-418a-8593-c5ac5f66ae2a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:56.957089 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-9274f555-cfae-418a-8593-c5ac5f66ae2a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:56.959511 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:32:56.965551 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9274f555-cfae-418a-8593-c5ac5f66ae2a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:56.966005 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9274f555-cfae-418a-8593-c5ac5f66ae2a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:56.966776 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9274f555-cfae-418a-8593-c5ac5f66ae2a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:56.967212 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9274f555-cfae-418a-8593-c5ac5f66ae2a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:57.100639 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-9274f555-cfae-418a-8593-c5ac5f66ae2a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:57.108600 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-9274f555-cfae-418a-8593-c5ac5f66ae2a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:57.110105 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-9274f555-cfae-418a-8593-c5ac5f66ae2a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:57.111263 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-9274f555-cfae-418a-8593-c5ac5f66ae2a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1721 microversion: 2.20 time: 0.158767 Jul 07 10:32:57.111838 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 384/747] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:32:56 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:32:58.129132 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-75d6c3fd-9b9e-4d7d-b18d-f66f2d94bc10 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:58.129735 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-75d6c3fd-9b9e-4d7d-b18d-f66f2d94bc10 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:58.136881 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-75d6c3fd-9b9e-4d7d-b18d-f66f2d94bc10 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:58.137324 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-75d6c3fd-9b9e-4d7d-b18d-f66f2d94bc10 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:58.138075 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-75d6c3fd-9b9e-4d7d-b18d-f66f2d94bc10 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:58.138504 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-75d6c3fd-9b9e-4d7d-b18d-f66f2d94bc10 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:58.263480 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-75d6c3fd-9b9e-4d7d-b18d-f66f2d94bc10 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:58.271454 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-75d6c3fd-9b9e-4d7d-b18d-f66f2d94bc10 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:58.272989 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-75d6c3fd-9b9e-4d7d-b18d-f66f2d94bc10 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:58.274138 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-75d6c3fd-9b9e-4d7d-b18d-f66f2d94bc10 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1664 microversion: 2.20 time: 0.148955 Jul 07 10:32:58.274700 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 364/748] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:32:58 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1664 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:32:58.291710 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-439358e4-c0dd-4918-8b8e-3ea886fcfd66 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5132fb80-003c-40ef-890f-b5af65110b5e"}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:32:58.292793 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-439358e4-c0dd-4918-8b8e-3ea886fcfd66 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:58.299117 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-439358e4-c0dd-4918-8b8e-3ea886fcfd66 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:58.299567 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-439358e4-c0dd-4918-8b8e-3ea886fcfd66 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:58.300364 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-439358e4-c0dd-4918-8b8e-3ea886fcfd66 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:58.300799 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-439358e4-c0dd-4918-8b8e-3ea886fcfd66 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:58.488701 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:32:58.578307 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-c36bbd0f-fe43-4a4d-b1fb-1b22b008dca1 req-0df4766f-bb20-463e-8ac7-8683f9ee06bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b52e1947-1b4e-4a83-9041-ea3b84be027f", "name": "network-vif-unplugged", "status": "completed", "tag": "ec13cec0-c49a-4b4e-b223-9bc0ab7b4152"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:32:58.584897 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-439358e4-c0dd-4918-8b8e-3ea886fcfd66 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "POST /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.297621 Jul 07 10:32:58.586112 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 385/749] 10.222.0.16 () {62 vars in 1363 bytes} [Thu Jul 7 10:32:58 2022] POST /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f/os-volume_attachments => generated 188 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 10:32:58.588208 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-c36bbd0f-fe43-4a4d-b1fb-1b22b008dca1 req-0df4766f-bb20-463e-8ac7-8683f9ee06bb service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:58.588719 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-c36bbd0f-fe43-4a4d-b1fb-1b22b008dca1 req-0df4766f-bb20-463e-8ac7-8683f9ee06bb service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:58.604338 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.compute.server_external_events [req-c36bbd0f-fe43-4a4d-b1fb-1b22b008dca1 req-0df4766f-bb20-463e-8ac7-8683f9ee06bb service nova] Unable to find a host for instance b52e1947-1b4e-4a83-9041-ea3b84be027f. Dropping event network-vif-unplugged {{(pid=117647) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 07 10:32:58.605225 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-c36bbd0f-fe43-4a4d-b1fb-1b22b008dca1 req-0df4766f-bb20-463e-8ac7-8683f9ee06bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031497 Jul 07 10:32:58.606114 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 365/750] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 07 10:32:58.700413 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-90c169cb-91ca-446f-84df-3e9710a66bee tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:32:58.700981 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-90c169cb-91ca-446f-84df-3e9710a66bee tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:58.709354 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-90c169cb-91ca-446f-84df-3e9710a66bee tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:58.709805 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-90c169cb-91ca-446f-84df-3e9710a66bee tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:58.711108 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-90c169cb-91ca-446f-84df-3e9710a66bee tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:58.711550 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-90c169cb-91ca-446f-84df-3e9710a66bee tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:58.786687 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-90c169cb-91ca-446f-84df-3e9710a66bee tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "POST /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f/action" status: 202 len: 0 microversion: 2.20 time: 0.090001 Jul 07 10:32:58.787297 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 386/751] 10.222.0.16 () {62 vars in 1318 bytes} [Thu Jul 7 10:32:58 2022] POST /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 07 10:32:58.796008 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8a09e446-c661-492b-bb2a-95f2ec8cc022 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:58.796622 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8a09e446-c661-492b-bb2a-95f2ec8cc022 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:58.802680 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8a09e446-c661-492b-bb2a-95f2ec8cc022 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:58.803130 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8a09e446-c661-492b-bb2a-95f2ec8cc022 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:58.803922 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8a09e446-c661-492b-bb2a-95f2ec8cc022 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:58.804393 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8a09e446-c661-492b-bb2a-95f2ec8cc022 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:58.938122 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8a09e446-c661-492b-bb2a-95f2ec8cc022 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:58.947388 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8a09e446-c661-492b-bb2a-95f2ec8cc022 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:58.948915 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8a09e446-c661-492b-bb2a-95f2ec8cc022 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:32:58.950072 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8a09e446-c661-492b-bb2a-95f2ec8cc022 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1750 microversion: 2.20 time: 0.158156 Jul 07 10:32:58.950632 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 366/752] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:32:58 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1750 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:32:59.969669 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-864661ea-f05e-4929-9b30-179a917dfc0d tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:32:59.970253 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-864661ea-f05e-4929-9b30-179a917dfc0d tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:32:59.977281 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-864661ea-f05e-4929-9b30-179a917dfc0d tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:59.977724 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-864661ea-f05e-4929-9b30-179a917dfc0d tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:32:59.978478 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-864661ea-f05e-4929-9b30-179a917dfc0d tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:32:59.978939 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-864661ea-f05e-4929-9b30-179a917dfc0d tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:00.108711 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-864661ea-f05e-4929-9b30-179a917dfc0d tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:00.117307 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-864661ea-f05e-4929-9b30-179a917dfc0d tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:00.118854 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-864661ea-f05e-4929-9b30-179a917dfc0d tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:00.120055 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-864661ea-f05e-4929-9b30-179a917dfc0d tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1752 microversion: 2.20 time: 0.154245 Jul 07 10:33:00.120605 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 387/753] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:32:59 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:33:01.138954 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-abe7115f-171c-4a98-b61b-19f532cb0b3c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:01.139564 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-abe7115f-171c-4a98-b61b-19f532cb0b3c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:01.146129 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-abe7115f-171c-4a98-b61b-19f532cb0b3c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:01.146577 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-abe7115f-171c-4a98-b61b-19f532cb0b3c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:01.147344 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-abe7115f-171c-4a98-b61b-19f532cb0b3c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:01.147946 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-abe7115f-171c-4a98-b61b-19f532cb0b3c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:01.305209 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-abe7115f-171c-4a98-b61b-19f532cb0b3c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:01.313858 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-abe7115f-171c-4a98-b61b-19f532cb0b3c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:01.318637 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-abe7115f-171c-4a98-b61b-19f532cb0b3c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:01.320003 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-abe7115f-171c-4a98-b61b-19f532cb0b3c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1808 microversion: 2.20 time: 0.184847 Jul 07 10:33:01.320554 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 367/754] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:33:01 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:33:02.338748 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-318d2e0e-62dd-431b-89cf-b6c66e974b84 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:02.340018 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-318d2e0e-62dd-431b-89cf-b6c66e974b84 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:02.351223 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-318d2e0e-62dd-431b-89cf-b6c66e974b84 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:02.351678 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-318d2e0e-62dd-431b-89cf-b6c66e974b84 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:02.352479 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-318d2e0e-62dd-431b-89cf-b6c66e974b84 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:02.352913 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-318d2e0e-62dd-431b-89cf-b6c66e974b84 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:02.497659 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-318d2e0e-62dd-431b-89cf-b6c66e974b84 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:02.512880 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-318d2e0e-62dd-431b-89cf-b6c66e974b84 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:02.514478 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-318d2e0e-62dd-431b-89cf-b6c66e974b84 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:02.515726 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-318d2e0e-62dd-431b-89cf-b6c66e974b84 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1808 microversion: 2.20 time: 0.181445 Jul 07 10:33:02.516311 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 388/755] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:33:02 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:33:03.534055 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-83e12530-8ff1-4743-a571-f20a21bb94a7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:03.534676 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-83e12530-8ff1-4743-a571-f20a21bb94a7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:03.541846 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-83e12530-8ff1-4743-a571-f20a21bb94a7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:03.542387 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-83e12530-8ff1-4743-a571-f20a21bb94a7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:03.543250 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-83e12530-8ff1-4743-a571-f20a21bb94a7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:03.543699 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-83e12530-8ff1-4743-a571-f20a21bb94a7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:03.566015 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=100 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:33:03.689673 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-83e12530-8ff1-4743-a571-f20a21bb94a7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:03.699344 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-83e12530-8ff1-4743-a571-f20a21bb94a7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:03.700879 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-83e12530-8ff1-4743-a571-f20a21bb94a7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:03.702049 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-83e12530-8ff1-4743-a571-f20a21bb94a7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1808 microversion: 2.20 time: 0.172177 Jul 07 10:33:03.702601 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 368/756] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:33:03 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:33:04.721217 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-8d41961f-3421-4dbe-a08b-6f24ce5465a4 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:04.721860 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-8d41961f-3421-4dbe-a08b-6f24ce5465a4 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:04.729204 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8d41961f-3421-4dbe-a08b-6f24ce5465a4 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:04.729662 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8d41961f-3421-4dbe-a08b-6f24ce5465a4 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:04.730439 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8d41961f-3421-4dbe-a08b-6f24ce5465a4 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:04.730883 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8d41961f-3421-4dbe-a08b-6f24ce5465a4 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:04.864080 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-8d41961f-3421-4dbe-a08b-6f24ce5465a4 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:04.872769 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-8d41961f-3421-4dbe-a08b-6f24ce5465a4 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:04.874294 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-8d41961f-3421-4dbe-a08b-6f24ce5465a4 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:04.875464 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-8d41961f-3421-4dbe-a08b-6f24ce5465a4 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1808 microversion: 2.20 time: 0.158444 Jul 07 10:33:04.876249 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 389/757] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:33:04 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:33:05.893008 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b1e8f9ce-6c49-4fe4-94db-3590b968e0da tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:05.893628 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b1e8f9ce-6c49-4fe4-94db-3590b968e0da tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:05.900275 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b1e8f9ce-6c49-4fe4-94db-3590b968e0da tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:05.900730 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b1e8f9ce-6c49-4fe4-94db-3590b968e0da tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:05.901513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b1e8f9ce-6c49-4fe4-94db-3590b968e0da tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:05.901954 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b1e8f9ce-6c49-4fe4-94db-3590b968e0da tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:06.190892 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b1e8f9ce-6c49-4fe4-94db-3590b968e0da tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:06.199662 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b1e8f9ce-6c49-4fe4-94db-3590b968e0da tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:06.201196 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b1e8f9ce-6c49-4fe4-94db-3590b968e0da tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:06.202373 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b1e8f9ce-6c49-4fe4-94db-3590b968e0da tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1808 microversion: 2.20 time: 0.313308 Jul 07 10:33:06.202921 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 369/758] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:33:05 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1808 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:33:07.220841 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a07edc65-5f8b-4366-ab07-4f1ad9d0c807 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:07.221479 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-a07edc65-5f8b-4366-ab07-4f1ad9d0c807 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:07.229040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a07edc65-5f8b-4366-ab07-4f1ad9d0c807 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:07.229262 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a07edc65-5f8b-4366-ab07-4f1ad9d0c807 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:07.230174 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a07edc65-5f8b-4366-ab07-4f1ad9d0c807 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:07.230480 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a07edc65-5f8b-4366-ab07-4f1ad9d0c807 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:07.369675 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-a07edc65-5f8b-4366-ab07-4f1ad9d0c807 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:07.378137 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-a07edc65-5f8b-4366-ab07-4f1ad9d0c807 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:07.379680 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-a07edc65-5f8b-4366-ab07-4f1ad9d0c807 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:07.380885 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-a07edc65-5f8b-4366-ab07-4f1ad9d0c807 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1808 microversion: 2.20 time: 0.164016 Jul 07 10:33:07.381444 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 390/759] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:33:07 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 10:33:08.399200 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-733b1c17-589b-4949-837e-df7ac165f2c3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:08.399891 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-733b1c17-589b-4949-837e-df7ac165f2c3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:08.406580 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-733b1c17-589b-4949-837e-df7ac165f2c3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:08.407164 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-733b1c17-589b-4949-837e-df7ac165f2c3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:08.408194 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-733b1c17-589b-4949-837e-df7ac165f2c3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:08.408729 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-733b1c17-589b-4949-837e-df7ac165f2c3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:08.555355 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-733b1c17-589b-4949-837e-df7ac165f2c3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:08.565126 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-733b1c17-589b-4949-837e-df7ac165f2c3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:08.566804 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-733b1c17-589b-4949-837e-df7ac165f2c3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:08.568476 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-733b1c17-589b-4949-837e-df7ac165f2c3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1808 microversion: 2.20 time: 0.173765 Jul 07 10:33:08.569360 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 370/760] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:33:08 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:33:09.588358 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-fec05dfb-b6df-4863-b5a0-607e6ba97885 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:09.590261 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-fec05dfb-b6df-4863-b5a0-607e6ba97885 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:09.597409 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fec05dfb-b6df-4863-b5a0-607e6ba97885 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:09.597891 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fec05dfb-b6df-4863-b5a0-607e6ba97885 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:09.598668 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fec05dfb-b6df-4863-b5a0-607e6ba97885 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:09.599110 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fec05dfb-b6df-4863-b5a0-607e6ba97885 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:09.736753 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-fec05dfb-b6df-4863-b5a0-607e6ba97885 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:09.746028 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-fec05dfb-b6df-4863-b5a0-607e6ba97885 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:09.747534 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-fec05dfb-b6df-4863-b5a0-607e6ba97885 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:09.748830 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-fec05dfb-b6df-4863-b5a0-607e6ba97885 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1808 microversion: 2.20 time: 0.165753 Jul 07 10:33:09.749595 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 391/761] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:33:09 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:33:10.766300 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-dd2c6a9c-babb-4e75-b86e-f47fd57f7ea3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:10.766903 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-dd2c6a9c-babb-4e75-b86e-f47fd57f7ea3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:10.773430 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dd2c6a9c-babb-4e75-b86e-f47fd57f7ea3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:10.773880 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dd2c6a9c-babb-4e75-b86e-f47fd57f7ea3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:10.774636 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dd2c6a9c-babb-4e75-b86e-f47fd57f7ea3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:10.775070 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dd2c6a9c-babb-4e75-b86e-f47fd57f7ea3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:10.899810 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-dd2c6a9c-babb-4e75-b86e-f47fd57f7ea3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:10.908157 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-dd2c6a9c-babb-4e75-b86e-f47fd57f7ea3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:10.909673 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-dd2c6a9c-babb-4e75-b86e-f47fd57f7ea3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:10.910831 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-dd2c6a9c-babb-4e75-b86e-f47fd57f7ea3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1808 microversion: 2.20 time: 0.148408 Jul 07 10:33:10.911406 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 371/762] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:33:10 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 10:33:11.928557 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-2b9d50d0-df49-4bb6-9bcd-a84c25dfd4bb tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:11.929190 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-2b9d50d0-df49-4bb6-9bcd-a84c25dfd4bb tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:11.935532 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2b9d50d0-df49-4bb6-9bcd-a84c25dfd4bb tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:11.936023 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2b9d50d0-df49-4bb6-9bcd-a84c25dfd4bb tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:11.936779 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2b9d50d0-df49-4bb6-9bcd-a84c25dfd4bb tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:11.937211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2b9d50d0-df49-4bb6-9bcd-a84c25dfd4bb tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:12.061109 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-2b9d50d0-df49-4bb6-9bcd-a84c25dfd4bb tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:12.070310 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-2b9d50d0-df49-4bb6-9bcd-a84c25dfd4bb tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:12.071903 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-2b9d50d0-df49-4bb6-9bcd-a84c25dfd4bb tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:12.073050 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-2b9d50d0-df49-4bb6-9bcd-a84c25dfd4bb tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1808 microversion: 2.20 time: 0.148434 Jul 07 10:33:12.073596 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 392/763] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:33:11 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:33:13.091365 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ebfd1c43-de0b-401a-9757-ab4e4fe133e9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:13.092003 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ebfd1c43-de0b-401a-9757-ab4e4fe133e9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:13.098500 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ebfd1c43-de0b-401a-9757-ab4e4fe133e9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:13.098955 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ebfd1c43-de0b-401a-9757-ab4e4fe133e9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:13.099725 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ebfd1c43-de0b-401a-9757-ab4e4fe133e9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:13.100191 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ebfd1c43-de0b-401a-9757-ab4e4fe133e9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:13.228613 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ebfd1c43-de0b-401a-9757-ab4e4fe133e9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:13.236862 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ebfd1c43-de0b-401a-9757-ab4e4fe133e9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:13.238352 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ebfd1c43-de0b-401a-9757-ab4e4fe133e9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:13.239502 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ebfd1c43-de0b-401a-9757-ab4e4fe133e9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1808 microversion: 2.20 time: 0.152122 Jul 07 10:33:13.240083 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 372/764] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:33:13 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:33:14.257578 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-7b88a9d2-baf0-400f-a7f6-9a37fd5a2c25 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:14.258208 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-7b88a9d2-baf0-400f-a7f6-9a37fd5a2c25 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:14.264695 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7b88a9d2-baf0-400f-a7f6-9a37fd5a2c25 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:14.265149 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7b88a9d2-baf0-400f-a7f6-9a37fd5a2c25 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:14.265898 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7b88a9d2-baf0-400f-a7f6-9a37fd5a2c25 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:14.266336 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7b88a9d2-baf0-400f-a7f6-9a37fd5a2c25 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:14.394928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-7b88a9d2-baf0-400f-a7f6-9a37fd5a2c25 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:14.403840 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-7b88a9d2-baf0-400f-a7f6-9a37fd5a2c25 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:14.405340 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-7b88a9d2-baf0-400f-a7f6-9a37fd5a2c25 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:14.406484 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-7b88a9d2-baf0-400f-a7f6-9a37fd5a2c25 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1808 microversion: 2.20 time: 0.152784 Jul 07 10:33:14.407030 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 393/765] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:33:14 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:33:15.425144 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6a905fc2-3f4d-4c7c-b259-597cde1cedb1 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:15.425758 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6a905fc2-3f4d-4c7c-b259-597cde1cedb1 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:15.432517 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6a905fc2-3f4d-4c7c-b259-597cde1cedb1 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:15.432973 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6a905fc2-3f4d-4c7c-b259-597cde1cedb1 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:15.433736 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6a905fc2-3f4d-4c7c-b259-597cde1cedb1 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:15.434181 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6a905fc2-3f4d-4c7c-b259-597cde1cedb1 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:15.561799 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6a905fc2-3f4d-4c7c-b259-597cde1cedb1 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:15.570351 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6a905fc2-3f4d-4c7c-b259-597cde1cedb1 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:15.571916 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6a905fc2-3f4d-4c7c-b259-597cde1cedb1 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:15.573072 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6a905fc2-3f4d-4c7c-b259-597cde1cedb1 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1808 microversion: 2.20 time: 0.151993 Jul 07 10:33:15.573629 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 373/766] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:33:15 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:33:16.591719 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-2d5e4a14-446d-4fd6-95f2-d8d4dea98189 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:16.592341 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-2d5e4a14-446d-4fd6-95f2-d8d4dea98189 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:16.598967 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2d5e4a14-446d-4fd6-95f2-d8d4dea98189 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:16.599413 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2d5e4a14-446d-4fd6-95f2-d8d4dea98189 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:16.600207 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2d5e4a14-446d-4fd6-95f2-d8d4dea98189 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:16.601214 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2d5e4a14-446d-4fd6-95f2-d8d4dea98189 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:16.728667 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-2d5e4a14-446d-4fd6-95f2-d8d4dea98189 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:16.736951 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-2d5e4a14-446d-4fd6-95f2-d8d4dea98189 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:16.738461 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-2d5e4a14-446d-4fd6-95f2-d8d4dea98189 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:16.739624 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-2d5e4a14-446d-4fd6-95f2-d8d4dea98189 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1808 microversion: 2.20 time: 0.151808 Jul 07 10:33:16.740208 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 394/767] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:33:16 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:33:17.757638 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e03621fc-051d-43fa-9ea2-db64d4864dbc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:17.758228 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e03621fc-051d-43fa-9ea2-db64d4864dbc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:17.764670 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e03621fc-051d-43fa-9ea2-db64d4864dbc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:17.765123 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e03621fc-051d-43fa-9ea2-db64d4864dbc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:17.765887 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e03621fc-051d-43fa-9ea2-db64d4864dbc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:17.766325 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e03621fc-051d-43fa-9ea2-db64d4864dbc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:17.898557 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e03621fc-051d-43fa-9ea2-db64d4864dbc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:17.906799 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e03621fc-051d-43fa-9ea2-db64d4864dbc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:17.908342 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e03621fc-051d-43fa-9ea2-db64d4864dbc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:17.909504 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e03621fc-051d-43fa-9ea2-db64d4864dbc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1808 microversion: 2.20 time: 0.155793 Jul 07 10:33:17.910059 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 374/768] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:33:17 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:33:18.927352 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-4a1b5b32-2986-4f54-856f-3b3bd1b6d47c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:18.928105 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-4a1b5b32-2986-4f54-856f-3b3bd1b6d47c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:18.935050 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4a1b5b32-2986-4f54-856f-3b3bd1b6d47c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:18.935501 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4a1b5b32-2986-4f54-856f-3b3bd1b6d47c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:18.936291 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4a1b5b32-2986-4f54-856f-3b3bd1b6d47c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:18.936731 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4a1b5b32-2986-4f54-856f-3b3bd1b6d47c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:19.066299 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-4a1b5b32-2986-4f54-856f-3b3bd1b6d47c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:19.075554 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-4a1b5b32-2986-4f54-856f-3b3bd1b6d47c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:19.077099 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-4a1b5b32-2986-4f54-856f-3b3bd1b6d47c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:19.078257 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-4a1b5b32-2986-4f54-856f-3b3bd1b6d47c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1808 microversion: 2.20 time: 0.154690 Jul 07 10:33:19.078827 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 395/769] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:33:18 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:33:20.096164 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8723f971-832a-4580-aa38-4fcaf5651258 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:20.096770 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8723f971-832a-4580-aa38-4fcaf5651258 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:20.103697 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8723f971-832a-4580-aa38-4fcaf5651258 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:20.104178 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8723f971-832a-4580-aa38-4fcaf5651258 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:20.104936 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8723f971-832a-4580-aa38-4fcaf5651258 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:20.105374 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8723f971-832a-4580-aa38-4fcaf5651258 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:20.230709 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8723f971-832a-4580-aa38-4fcaf5651258 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:20.238961 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8723f971-832a-4580-aa38-4fcaf5651258 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:20.240504 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8723f971-832a-4580-aa38-4fcaf5651258 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:20.242265 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8723f971-832a-4580-aa38-4fcaf5651258 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1808 microversion: 2.20 time: 0.149993 Jul 07 10:33:20.242823 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 375/770] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:33:20 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:33:20.797473 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-eb59d44b-4be4-4224-9cfc-2f9e21affac5 req-50a781b6-d955-46c5-8069-05ba16c461fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b52e1947-1b4e-4a83-9041-ea3b84be027f", "name": "network-vif-plugged", "status": "completed", "tag": "ec13cec0-c49a-4b4e-b223-9bc0ab7b4152"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:33:20.807500 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-eb59d44b-4be4-4224-9cfc-2f9e21affac5 req-50a781b6-d955-46c5-8069-05ba16c461fd service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:20.807982 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-eb59d44b-4be4-4224-9cfc-2f9e21affac5 req-50a781b6-d955-46c5-8069-05ba16c461fd service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:20.819819 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-eb59d44b-4be4-4224-9cfc-2f9e21affac5 req-50a781b6-d955-46c5-8069-05ba16c461fd service nova] Creating event network-vif-plugged:ec13cec0-c49a-4b4e-b223-9bc0ab7b4152 for instance b52e1947-1b4e-4a83-9041-ea3b84be027f on hv-cinder-82282 Jul 07 10:33:20.824826 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-eb59d44b-4be4-4224-9cfc-2f9e21affac5 req-50a781b6-d955-46c5-8069-05ba16c461fd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031090 Jul 07 10:33:20.825558 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 396/771] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:33:21.260911 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-998d7c62-36d3-4b91-977f-6c29e5cbdae8 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:21.261541 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-998d7c62-36d3-4b91-977f-6c29e5cbdae8 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:21.264129 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=32 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:33:21.270176 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-998d7c62-36d3-4b91-977f-6c29e5cbdae8 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:21.270715 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-998d7c62-36d3-4b91-977f-6c29e5cbdae8 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:21.271505 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-998d7c62-36d3-4b91-977f-6c29e5cbdae8 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:21.271995 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-998d7c62-36d3-4b91-977f-6c29e5cbdae8 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:21.429526 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-998d7c62-36d3-4b91-977f-6c29e5cbdae8 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:21.438285 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-998d7c62-36d3-4b91-977f-6c29e5cbdae8 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:21.439879 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-998d7c62-36d3-4b91-977f-6c29e5cbdae8 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:21.441053 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-998d7c62-36d3-4b91-977f-6c29e5cbdae8 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1808 microversion: 2.20 time: 0.184708 Jul 07 10:33:21.441610 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 376/772] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:33:21 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:33:22.460646 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-5153bede-719d-4e75-94ad-52055b773dfd tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:22.461266 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-5153bede-719d-4e75-94ad-52055b773dfd tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:22.467943 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5153bede-719d-4e75-94ad-52055b773dfd tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:22.468403 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5153bede-719d-4e75-94ad-52055b773dfd tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:22.469171 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5153bede-719d-4e75-94ad-52055b773dfd tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:22.469620 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5153bede-719d-4e75-94ad-52055b773dfd tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:22.599387 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-5153bede-719d-4e75-94ad-52055b773dfd tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:22.608614 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-5153bede-719d-4e75-94ad-52055b773dfd tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:22.610253 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-5153bede-719d-4e75-94ad-52055b773dfd tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:22.611399 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-5153bede-719d-4e75-94ad-52055b773dfd tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1808 microversion: 2.20 time: 0.155146 Jul 07 10:33:22.612073 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 397/773] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:33:22 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:33:23.629252 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4f09908b-a3dd-45e7-ae0c-e08733f7f159 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:23.629998 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-4f09908b-a3dd-45e7-ae0c-e08733f7f159 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:23.637330 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4f09908b-a3dd-45e7-ae0c-e08733f7f159 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:23.637782 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4f09908b-a3dd-45e7-ae0c-e08733f7f159 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:23.638561 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4f09908b-a3dd-45e7-ae0c-e08733f7f159 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:23.638993 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4f09908b-a3dd-45e7-ae0c-e08733f7f159 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:23.765394 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-4f09908b-a3dd-45e7-ae0c-e08733f7f159 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:23.773719 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-4f09908b-a3dd-45e7-ae0c-e08733f7f159 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:23.775151 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-4f09908b-a3dd-45e7-ae0c-e08733f7f159 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:23.776336 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-4f09908b-a3dd-45e7-ae0c-e08733f7f159 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1795 microversion: 2.20 time: 0.151042 Jul 07 10:33:23.776889 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 377/774] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:33:23 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1795 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:33:28.052594 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-fbd15eea-5f90-4bce-88ef-2f4ebcd5e7ae tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:28.053104 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-fbd15eea-5f90-4bce-88ef-2f4ebcd5e7ae tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:28.054577 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-809d6a77-53b2-43fe-b6aa-3f21f7e31ad5 req-2740f17f-7109-4736-b7f2-465f7d720018 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f3963fd-1a48-4f86-a15e-c4fbcadc5911", "tag": "52658524-0e22-481a-99ab-eb339029366f"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:33:28.056053 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_api:SELECT=30 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:33:28.061340 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fbd15eea-5f90-4bce-88ef-2f4ebcd5e7ae tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:28.061796 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fbd15eea-5f90-4bce-88ef-2f4ebcd5e7ae tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:28.062573 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fbd15eea-5f90-4bce-88ef-2f4ebcd5e7ae tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:28.063010 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fbd15eea-5f90-4bce-88ef-2f4ebcd5e7ae tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:28.063758 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-809d6a77-53b2-43fe-b6aa-3f21f7e31ad5 req-2740f17f-7109-4736-b7f2-465f7d720018 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:28.064281 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-809d6a77-53b2-43fe-b6aa-3f21f7e31ad5 req-2740f17f-7109-4736-b7f2-465f7d720018 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:28.086333 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-809d6a77-53b2-43fe-b6aa-3f21f7e31ad5 req-2740f17f-7109-4736-b7f2-465f7d720018 service nova] Creating event network-changed:52658524-0e22-481a-99ab-eb339029366f for instance 5f3963fd-1a48-4f86-a15e-c4fbcadc5911 on hv-cinder-82282 Jul 07 10:33:28.091779 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-809d6a77-53b2-43fe-b6aa-3f21f7e31ad5 req-2740f17f-7109-4736-b7f2-465f7d720018 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040789 Jul 07 10:33:28.092825 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 378/775] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:33:28.100626 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-fbd15eea-5f90-4bce-88ef-2f4ebcd5e7ae tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Going to try to terminate instance {{(pid=117646) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 10:33:28.202475 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-fbd15eea-5f90-4bce-88ef-2f4ebcd5e7ae tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 204 len: 0 microversion: 2.1 time: 0.153655 Jul 07 10:33:28.203160 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 398/776] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jul 7 10:33:28 2022] DELETE /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 10:33:28.213204 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-cbf4efad-6725-466f-b3d8-a3cc0d822e35 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:28.213909 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-cbf4efad-6725-466f-b3d8-a3cc0d822e35 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:28.220376 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cbf4efad-6725-466f-b3d8-a3cc0d822e35 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:28.220835 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cbf4efad-6725-466f-b3d8-a3cc0d822e35 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:28.221618 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cbf4efad-6725-466f-b3d8-a3cc0d822e35 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:28.222063 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cbf4efad-6725-466f-b3d8-a3cc0d822e35 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:28.373185 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-cbf4efad-6725-466f-b3d8-a3cc0d822e35 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:28.380659 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-cbf4efad-6725-466f-b3d8-a3cc0d822e35 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1565 microversion: 2.1 time: 0.172388 Jul 07 10:33:28.381780 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 379/777] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:33:28 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:33:28.426921 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-456f4e19-dc78-4e41-8280-932871d857cf tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:28.427505 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-456f4e19-dc78-4e41-8280-932871d857cf tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:28.434071 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-456f4e19-dc78-4e41-8280-932871d857cf tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:28.434529 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-456f4e19-dc78-4e41-8280-932871d857cf tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:28.435298 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-456f4e19-dc78-4e41-8280-932871d857cf tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:28.435772 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-456f4e19-dc78-4e41-8280-932871d857cf tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:28.454656 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:33:28.467523 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-456f4e19-dc78-4e41-8280-932871d857cf tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12/ips" status: 200 len: 149 microversion: 2.1 time: 0.044773 Jul 07 10:33:28.468323 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 399/778] 10.222.0.16 () {58 vars in 1247 bytes} [Thu Jul 7 10:33:28 2022] GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:33:29.398351 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-dda9a910-da28-48be-9734-93c40fce947b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:29.398955 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-dda9a910-da28-48be-9734-93c40fce947b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:29.405403 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dda9a910-da28-48be-9734-93c40fce947b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:29.405848 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dda9a910-da28-48be-9734-93c40fce947b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:29.406597 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dda9a910-da28-48be-9734-93c40fce947b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:29.407024 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dda9a910-da28-48be-9734-93c40fce947b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:29.577043 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-dda9a910-da28-48be-9734-93c40fce947b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:29.584533 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-dda9a910-da28-48be-9734-93c40fce947b tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1565 microversion: 2.1 time: 0.190020 Jul 07 10:33:29.585103 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 380/779] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:33:29 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1565 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:33:29.825168 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-63987b48-c4f8-476f-ac8e-4d45123891a3 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bea583e7-7d69-41bc-9d27-68edb95d9f91"}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:33:29.826282 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-63987b48-c4f8-476f-ac8e-4d45123891a3 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:29.833610 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-63987b48-c4f8-476f-ac8e-4d45123891a3 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:29.834065 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-63987b48-c4f8-476f-ac8e-4d45123891a3 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:29.834834 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-63987b48-c4f8-476f-ac8e-4d45123891a3 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:29.835274 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-63987b48-c4f8-476f-ac8e-4d45123891a3 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:30.076070 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-63987b48-c4f8-476f-ac8e-4d45123891a3 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "POST /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254812 Jul 07 10:33:30.076851 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 400/780] 10.222.0.16 () {60 vars in 1322 bytes} [Thu Jul 7 10:33:29 2022] POST /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:33:30.374532 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-949760b7-b28b-49e3-86c9-42eae582892d req-153f279c-234e-4e04-8066-2b994d7e5893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3963fd-1a48-4f86-a15e-c4fbcadc5911", "name": "network-vif-deleted", "tag": "52658524-0e22-481a-99ab-eb339029366f"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:33:30.383878 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-949760b7-b28b-49e3-86c9-42eae582892d req-153f279c-234e-4e04-8066-2b994d7e5893 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:30.384337 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-949760b7-b28b-49e3-86c9-42eae582892d req-153f279c-234e-4e04-8066-2b994d7e5893 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:30.399485 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-949760b7-b28b-49e3-86c9-42eae582892d req-153f279c-234e-4e04-8066-2b994d7e5893 service nova] Creating event network-vif-deleted:52658524-0e22-481a-99ab-eb339029366f for instance 5f3963fd-1a48-4f86-a15e-c4fbcadc5911 on hv-cinder-82282 Jul 07 10:33:30.404278 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-949760b7-b28b-49e3-86c9-42eae582892d req-153f279c-234e-4e04-8066-2b994d7e5893 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033494 Jul 07 10:33:30.404876 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 381/781] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:33:30.603079 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-81263a28-ee95-4cb2-a0a3-da4d55d7aef5 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:30.604301 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-81263a28-ee95-4cb2-a0a3-da4d55d7aef5 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:30.612162 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-81263a28-ee95-4cb2-a0a3-da4d55d7aef5 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:30.612624 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-81263a28-ee95-4cb2-a0a3-da4d55d7aef5 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:30.613408 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-81263a28-ee95-4cb2-a0a3-da4d55d7aef5 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:30.613843 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-81263a28-ee95-4cb2-a0a3-da4d55d7aef5 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:30.680819 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-81263a28-ee95-4cb2-a0a3-da4d55d7aef5 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c69ecf2f23490c92ab315433273817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dabce5b3274cfcba5840982b59434e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:30.690627 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-81263a28-ee95-4cb2-a0a3-da4d55d7aef5 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 200 len: 1218 microversion: 2.1 time: 0.092184 Jul 07 10:33:30.691530 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 401/782] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:33:30 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:33:31.710295 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d8967f10-8f21-4014-8c35-289003e96035 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:31.710994 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d8967f10-8f21-4014-8c35-289003e96035 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] [instance: 5f3963fd-1a48-4f86-a15e-c4fbcadc5911] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:31.717183 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d8967f10-8f21-4014-8c35-289003e96035 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:31.717634 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d8967f10-8f21-4014-8c35-289003e96035 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:31.718425 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d8967f10-8f21-4014-8c35-289003e96035 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:31.718860 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d8967f10-8f21-4014-8c35-289003e96035 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:31.732353 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-d8967f10-8f21-4014-8c35-289003e96035 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] HTTP exception thrown: Instance 5f3963fd-1a48-4f86-a15e-c4fbcadc5911 could not be found. Jul 07 10:33:31.733940 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d8967f10-8f21-4014-8c35-289003e96035 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Request method failure captured: Jul 07 10:33:31.733940 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 HTTP/1.1 Jul 07 10:33:31.733940 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept: application/json Jul 07 10:33:31.733940 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jul 07 10:33:31.733940 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Connection: close Jul 07 10:33:31.733940 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jul 07 10:33:31.733940 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jul 07 10:33:31.733940 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Host: 10.222.0.16 Jul 07 10:33:31.733940 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jul 07 10:33:31.733940 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jul 07 10:33:31.733940 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABixrU7Y9ttK493wMRU0mqFLqbCX8YjUA4j-b9L8ZYanQVx4L9jaMZ2B7p40Zw5-7mUw7VHrCEj5ySUgng2vcoNixtjqthYhkBVgYLGJUbhdZXDQ7nbeRg7ecEchrwIozS_nEcjmRDZ_12L_ImnrxfxWq_6kMEmc2PvfvkM6VfP1l1IR8w Jul 07 10:33:31.733940 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jul 07 10:33:31.733940 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jul 07 10:33:31.733940 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jul 07 10:33:31.733940 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jul 07 10:33:31.733940 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jul 07 10:33:31.733940 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jul 07 10:33:31.733940 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Id: 21dabce5b3274cfcba5840982b59434e Jul 07 10:33:31.733940 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-TestShelveInstance-557692086 Jul 07 10:33:31.733940 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jul 07 10:33:31.733940 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jul 07 10:33:31.735482 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/21dabce5b3274cfcba5840982b59434e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/21dabce5b3274cfcba5840982b59434e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/21dabce5b3274cfcba5840982b59434e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_21dabce5b3274cfcba5840982b59434e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:33:31.735482 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-TestShelveInstance-557692086 Jul 07 10:33:31.735482 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 21dabce5b3274cfcba5840982b59434e Jul 07 10:33:31.735482 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-TestShelveInstance-557692086 Jul 07 10:33:31.735482 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User: tempest-TestShelveInstance-557692086-project Jul 07 10:33:31.735482 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jul 07 10:33:31.735482 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jul 07 10:33:31.735482 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Id: d8c69ecf2f23490c92ab315433273817 Jul 07 10:33:31.735482 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-TestShelveInstance-557692086-project Jul 07 10:33:31.735482 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: method: > Jul 07 10:33:31.735482 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: exception: Instance 5f3963fd-1a48-4f86-a15e-c4fbcadc5911 could not be found. Jul 07 10:33:31.735482 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: action_args: {'id': '5f3963fd-1a48-4f86-a15e-c4fbcadc5911'} Jul 07 10:33:31.736453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:33:31.736453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:33:31.736453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:33:31.736453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:33:31.736453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:33:31.736453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:33:31.736453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:33:31.736453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:33:31.736453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:33:31.736453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:33:31.736453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f3963fd-1a48-4f86-a15e-c4fbcadc5911 could not be found. Jul 07 10:33:31.736453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:33:31.736453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:33:31.736453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:33:31.736453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:33:31.736453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:33:31.736453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:33:31.736453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:33:31.736453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:33:31.736453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:33:31.737918 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:33:31.737918 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:33:31.737918 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:33:31.737918 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:33:31.737918 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:33:31.737918 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:33:31.737918 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:33:31.737918 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f3963fd-1a48-4f86-a15e-c4fbcadc5911 could not be found. Jul 07 10:33:31.737918 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:33:31.737918 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:33:31.737918 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:33:31.737918 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:33:31.737918 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:33:31.737918 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:33:31.737918 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:33:31.737918 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:33:31.737918 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f3963fd-1a48-4f86-a15e-c4fbcadc5911 could not be found. Jul 07 10:33:31.737918 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:33:31.739241 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d8967f10-8f21-4014-8c35-289003e96035 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Returning 404 to user: Instance 5f3963fd-1a48-4f86-a15e-c4fbcadc5911 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:33:31.739241 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d8967f10-8f21-4014-8c35-289003e96035 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911" status: 404 len: 111 microversion: 2.1 time: 0.030233 Jul 07 10:33:31.739241 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 382/783] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:33:31 2022] GET /compute/v2.1/servers/5f3963fd-1a48-4f86-a15e-c4fbcadc5911 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:33:31.894514 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a51ceea8-aeeb-40e8-96f7-c56f5999b124 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] Calling method '.version_select at 0x7f9e9e337f70>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:31.916089 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-a51ceea8-aeeb-40e8-96f7-c56f5999b124 tempest-TestShelveInstance-557692086 tempest-TestShelveInstance-557692086-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-619699422" status: 202 len: 0 microversion: 2.1 time: 0.025482 Jul 07 10:33:31.917090 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 402/784] 10.222.0.16 () {58 vars in 1250 bytes} [Thu Jul 7 10:33:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-619699422 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 10:33:37.610630 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-fe7044c6-d3c3-452c-af4b-b9eb17ae7f4d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Action: 'create', calling method: .version_select at 0x7f9e9e4933a0>, body: {"keypair": {"name": "tempest-keypair-489560912", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxZKHbImM0SodIIGPlEzCRYXLV+ACxiU8CJd3ZK7xznpzy9lFnQ56qoW6DdlocIa8PB8xSOiX7yuZv5j7R3r+nd+IHQ2ZeCkUQrjD1tyLAfOgZs8IdnNDvxgbNkRIFc9Q=="}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:33:37.628563 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-fe7044c6-d3c3-452c-af4b-b9eb17ae7f4d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Getting quotas for project 1568d5b1c4bb471f9de53f4d5cf7cc82. Resources: {'key_pairs'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:33:37.634671 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-fe7044c6-d3c3-452c-af4b-b9eb17ae7f4d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Getting quotas for user 1222d8bb50554d64ac674f109b6ad077 and project 1568d5b1c4bb471f9de53f4d5cf7cc82. Resources: {'key_pairs'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:33:37.661375 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-fe7044c6-d3c3-452c-af4b-b9eb17ae7f4d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054554 Jul 07 10:33:37.666312 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 383/785] 10.222.0.16 () {60 vars in 1158 bytes} [Thu Jul 7 10:33:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:33:39.085728 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-55153ad1-78cb-47b0-a5b4-334d53354247 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-65347003", "imageRef": "1c96509d-f65f-42b0-94b3-6fc590a93508", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ddda3840-6dd5-4197-ae4c-bd6a56e53d5c"}], "security_groups": [{"name": "tempest-securitygroup--593648481"}], "key_name": "tempest-keypair-489560912", "user_data": "}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:33:39.187718 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.network.neutron [None req-55153ad1-78cb-47b0-a5b4-334d53354247 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] validate_networks() for [('ddda3840-6dd5-4197-ae4c-bd6a56e53d5c', None, None, None, None, None)] {{(pid=117646) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 10:33:39.577881 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-55153ad1-78cb-47b0-a5b4-334d53354247 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Flavor limits 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 10:33:39.578309 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-55153ad1-78cb-47b0-a5b4-334d53354247 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Image limits 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 10:33:39.578785 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-55153ad1-78cb-47b0-a5b4-334d53354247 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Flavor pref 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 10:33:39.579242 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-55153ad1-78cb-47b0-a5b4-334d53354247 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Image pref 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 10:33:39.579691 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-55153ad1-78cb-47b0-a5b4-334d53354247 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 10:33:39.588958 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-55153ad1-78cb-47b0-a5b4-334d53354247 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:39.589411 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-55153ad1-78cb-47b0-a5b4-334d53354247 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:39.590205 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-55153ad1-78cb-47b0-a5b4-334d53354247 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:39.590644 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-55153ad1-78cb-47b0-a5b4-334d53354247 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:39.607713 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-55153ad1-78cb-47b0-a5b4-334d53354247 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Getting quotas for project 1568d5b1c4bb471f9de53f4d5cf7cc82. Resources: {'cores', 'ram', 'instances'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:33:39.611532 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-55153ad1-78cb-47b0-a5b4-334d53354247 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Getting quotas for user 1222d8bb50554d64ac674f109b6ad077 and project 1568d5b1c4bb471f9de53f4d5cf7cc82. Resources: {'cores', 'ram', 'instances'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:33:39.622251 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-55153ad1-78cb-47b0-a5b4-334d53354247 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Going to run 1 instances... {{(pid=117646) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 10:33:39.624505 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-55153ad1-78cb-47b0-a5b4-334d53354247 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c96509d-f65f-42b0-94b3-6fc590a93508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 10:33:39.670651 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-55153ad1-78cb-47b0-a5b4-334d53354247 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.591130 Jul 07 10:33:39.671720 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 403/786] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jul 7 10:33:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 10:33:39.682091 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-77eb0391-a9bc-4d1c-bc54-1a9a0ae71a4d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:39.683609 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-77eb0391-a9bc-4d1c-bc54-1a9a0ae71a4d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:39.758975 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-77eb0391-a9bc-4d1c-bc54-1a9a0ae71a4d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:39.766584 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-77eb0391-a9bc-4d1c-bc54-1a9a0ae71a4d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f" status: 200 len: 1239 microversion: 2.1 time: 0.088804 Jul 07 10:33:39.767147 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 384/787] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:33:39 2022] GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f => generated 1239 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:33:40.784522 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-d9ada0f8-803f-48a0-9f80-35dd305acb91 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:40.785071 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-d9ada0f8-803f-48a0-9f80-35dd305acb91 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:40.791108 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d9ada0f8-803f-48a0-9f80-35dd305acb91 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:40.791558 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d9ada0f8-803f-48a0-9f80-35dd305acb91 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:40.792355 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d9ada0f8-803f-48a0-9f80-35dd305acb91 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:40.792831 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d9ada0f8-803f-48a0-9f80-35dd305acb91 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:40.855397 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-d9ada0f8-803f-48a0-9f80-35dd305acb91 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:40.862848 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-d9ada0f8-803f-48a0-9f80-35dd305acb91 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f" status: 200 len: 1297 microversion: 2.1 time: 0.083049 Jul 07 10:33:40.863427 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 404/788] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:33:40 2022] GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f => generated 1297 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:33:41.880427 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ce3d29cf-1d39-4d5f-95af-17dfd7fe343b tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:41.882345 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ce3d29cf-1d39-4d5f-95af-17dfd7fe343b tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:41.884922 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=75 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:33:41.890857 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ce3d29cf-1d39-4d5f-95af-17dfd7fe343b tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:41.891400 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ce3d29cf-1d39-4d5f-95af-17dfd7fe343b tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:41.892285 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ce3d29cf-1d39-4d5f-95af-17dfd7fe343b tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:41.892955 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ce3d29cf-1d39-4d5f-95af-17dfd7fe343b tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:42.023217 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-ea9cc90d-6a40-423f-af11-44feab69796e req-ac1dd2b3-b527-4add-b834-c28b864fa335 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f", "tag": "302e7778-80d4-4a6f-8b2e-60b4176593e4"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:33:42.053491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-ea9cc90d-6a40-423f-af11-44feab69796e req-ac1dd2b3-b527-4add-b834-c28b864fa335 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:42.056039 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-ea9cc90d-6a40-423f-af11-44feab69796e req-ac1dd2b3-b527-4add-b834-c28b864fa335 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:42.070069 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-ea9cc90d-6a40-423f-af11-44feab69796e req-ac1dd2b3-b527-4add-b834-c28b864fa335 service nova] Creating event network-changed:302e7778-80d4-4a6f-8b2e-60b4176593e4 for instance d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f on hv-cinder-82282 Jul 07 10:33:42.077631 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-ea9cc90d-6a40-423f-af11-44feab69796e req-ac1dd2b3-b527-4add-b834-c28b864fa335 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059338 Jul 07 10:33:42.078246 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 405/789] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:33:42.137751 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ce3d29cf-1d39-4d5f-95af-17dfd7fe343b tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:42.145832 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ce3d29cf-1d39-4d5f-95af-17dfd7fe343b tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f" status: 200 len: 1364 microversion: 2.1 time: 0.269141 Jul 07 10:33:42.146742 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 385/790] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:33:41 2022] GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f => generated 1364 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:33:43.164054 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-56ec704f-1a96-4bf6-a72f-fbaaf3691222 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:43.164766 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-56ec704f-1a96-4bf6-a72f-fbaaf3691222 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:43.170902 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-56ec704f-1a96-4bf6-a72f-fbaaf3691222 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:43.171354 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-56ec704f-1a96-4bf6-a72f-fbaaf3691222 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:43.172136 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-56ec704f-1a96-4bf6-a72f-fbaaf3691222 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:43.172576 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-56ec704f-1a96-4bf6-a72f-fbaaf3691222 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:43.299319 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-56ec704f-1a96-4bf6-a72f-fbaaf3691222 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:43.307361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-56ec704f-1a96-4bf6-a72f-fbaaf3691222 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f" status: 200 len: 1364 microversion: 2.1 time: 0.148462 Jul 07 10:33:43.307970 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 406/791] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:33:43 2022] GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:33:44.324197 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a72c8200-d563-44dc-8b92-18d19158fc4f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:44.324806 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a72c8200-d563-44dc-8b92-18d19158fc4f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:44.331049 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a72c8200-d563-44dc-8b92-18d19158fc4f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:44.331434 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a72c8200-d563-44dc-8b92-18d19158fc4f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:44.332220 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a72c8200-d563-44dc-8b92-18d19158fc4f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:44.332655 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a72c8200-d563-44dc-8b92-18d19158fc4f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:44.457526 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a72c8200-d563-44dc-8b92-18d19158fc4f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:44.465440 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a72c8200-d563-44dc-8b92-18d19158fc4f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f" status: 200 len: 1364 microversion: 2.1 time: 0.145067 Jul 07 10:33:44.465996 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 386/792] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:33:44 2022] GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:33:45.482131 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-b8f04be9-5d31-4686-a48f-6eb17c19d837 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:45.482666 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-b8f04be9-5d31-4686-a48f-6eb17c19d837 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:45.489058 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b8f04be9-5d31-4686-a48f-6eb17c19d837 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:45.489510 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b8f04be9-5d31-4686-a48f-6eb17c19d837 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:45.490271 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b8f04be9-5d31-4686-a48f-6eb17c19d837 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:45.491275 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b8f04be9-5d31-4686-a48f-6eb17c19d837 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:45.619638 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-b8f04be9-5d31-4686-a48f-6eb17c19d837 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:45.627018 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-b8f04be9-5d31-4686-a48f-6eb17c19d837 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f" status: 200 len: 1364 microversion: 2.1 time: 0.148837 Jul 07 10:33:45.627605 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 407/793] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:33:45 2022] GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:33:46.644334 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-17dbe450-37d0-4965-964a-9def79d8e99f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:46.644943 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-17dbe450-37d0-4965-964a-9def79d8e99f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:46.651868 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-17dbe450-37d0-4965-964a-9def79d8e99f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:46.652318 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-17dbe450-37d0-4965-964a-9def79d8e99f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:46.653100 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-17dbe450-37d0-4965-964a-9def79d8e99f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:46.653532 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-17dbe450-37d0-4965-964a-9def79d8e99f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:46.784716 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-17dbe450-37d0-4965-964a-9def79d8e99f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:46.792888 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-17dbe450-37d0-4965-964a-9def79d8e99f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f" status: 200 len: 1364 microversion: 2.1 time: 0.152355 Jul 07 10:33:46.793462 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 387/794] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:33:46 2022] GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:33:46.937163 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-dc1ad8fd-df72-4e1d-b2ce-7c22c05bc07f req-4336e2a9-6204-4cba-b5e2-ba3e550de125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f", "name": "network-vif-plugged", "status": "completed", "tag": "302e7778-80d4-4a6f-8b2e-60b4176593e4"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:33:46.947177 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-dc1ad8fd-df72-4e1d-b2ce-7c22c05bc07f req-4336e2a9-6204-4cba-b5e2-ba3e550de125 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:46.947632 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-dc1ad8fd-df72-4e1d-b2ce-7c22c05bc07f req-4336e2a9-6204-4cba-b5e2-ba3e550de125 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:46.958638 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-dc1ad8fd-df72-4e1d-b2ce-7c22c05bc07f req-4336e2a9-6204-4cba-b5e2-ba3e550de125 service nova] Creating event network-vif-plugged:302e7778-80d4-4a6f-8b2e-60b4176593e4 for instance d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f on hv-cinder-82282 Jul 07 10:33:46.963953 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-dc1ad8fd-df72-4e1d-b2ce-7c22c05bc07f req-4336e2a9-6204-4cba-b5e2-ba3e550de125 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030974 Jul 07 10:33:46.964557 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 408/795] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:33:47.809620 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-97abc837-97aa-4eff-946f-c70f31edd8f0 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:47.810170 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-97abc837-97aa-4eff-946f-c70f31edd8f0 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:47.816663 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-97abc837-97aa-4eff-946f-c70f31edd8f0 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:47.817379 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-97abc837-97aa-4eff-946f-c70f31edd8f0 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:47.818141 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-97abc837-97aa-4eff-946f-c70f31edd8f0 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:47.819066 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-97abc837-97aa-4eff-946f-c70f31edd8f0 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:47.947403 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-97abc837-97aa-4eff-946f-c70f31edd8f0 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:47.954790 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-97abc837-97aa-4eff-946f-c70f31edd8f0 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f" status: 200 len: 1364 microversion: 2.1 time: 0.149109 Jul 07 10:33:47.955357 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 388/796] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:33:47 2022] GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:33:48.972656 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-f4ed2489-3824-4380-b8e0-1f6b4cff770f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:48.973359 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-f4ed2489-3824-4380-b8e0-1f6b4cff770f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:48.980174 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f4ed2489-3824-4380-b8e0-1f6b4cff770f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:48.980634 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f4ed2489-3824-4380-b8e0-1f6b4cff770f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:48.981401 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f4ed2489-3824-4380-b8e0-1f6b4cff770f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:48.981846 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f4ed2489-3824-4380-b8e0-1f6b4cff770f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:49.109706 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-f4ed2489-3824-4380-b8e0-1f6b4cff770f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:33:49.117266 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-f4ed2489-3824-4380-b8e0-1f6b4cff770f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f" status: 200 len: 1553 microversion: 2.1 time: 0.149352 Jul 07 10:33:49.117833 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 409/797] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:33:48 2022] GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:33:49.133349 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b5885364-b753-4003-ae53-9721c4a5fb14 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:33:49.133856 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b5885364-b753-4003-ae53-9721c4a5fb14 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:33:49.140298 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b5885364-b753-4003-ae53-9721c4a5fb14 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:49.140750 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b5885364-b753-4003-ae53-9721c4a5fb14 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:49.141511 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b5885364-b753-4003-ae53-9721c4a5fb14 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:49.141950 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b5885364-b753-4003-ae53-9721c4a5fb14 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:49.218071 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b5885364-b753-4003-ae53-9721c4a5fb14 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088670 Jul 07 10:33:49.218671 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 389/798] 10.222.0.16 () {58 vars in 1274 bytes} [Thu Jul 7 10:33:49 2022] GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:33:50.381238 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-298cbe80-e252-40ab-bb7c-51f07f7a5e6f req-f0baef20-27ee-493c-b84c-3dee2930fcd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f", "tag": "302e7778-80d4-4a6f-8b2e-60b4176593e4"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:33:50.384832 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell0:SELECT=2 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:33:50.385585 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell0:SELECT=6 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:33:50.392557 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-298cbe80-e252-40ab-bb7c-51f07f7a5e6f req-f0baef20-27ee-493c-b84c-3dee2930fcd8 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:33:50.392998 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-298cbe80-e252-40ab-bb7c-51f07f7a5e6f req-f0baef20-27ee-493c-b84c-3dee2930fcd8 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:33:50.404434 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-298cbe80-e252-40ab-bb7c-51f07f7a5e6f req-f0baef20-27ee-493c-b84c-3dee2930fcd8 service nova] Creating event network-changed:302e7778-80d4-4a6f-8b2e-60b4176593e4 for instance d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f on hv-cinder-82282 Jul 07 10:33:50.409689 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-298cbe80-e252-40ab-bb7c-51f07f7a5e6f req-f0baef20-27ee-493c-b84c-3dee2930fcd8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032026 Jul 07 10:33:50.410306 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 410/799] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:34:02.934396 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=6 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:34:02.935840 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:34:02.936466 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=28 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:34:02.940489 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-7fc2c85e-0d88-40c8-9ad9-56de81b21109 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:02.940984 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-7fc2c85e-0d88-40c8-9ad9-56de81b21109 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:02.948899 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7fc2c85e-0d88-40c8-9ad9-56de81b21109 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:02.949353 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7fc2c85e-0d88-40c8-9ad9-56de81b21109 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:02.950112 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7fc2c85e-0d88-40c8-9ad9-56de81b21109 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:02.950550 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7fc2c85e-0d88-40c8-9ad9-56de81b21109 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:02.979991 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-7fc2c85e-0d88-40c8-9ad9-56de81b21109 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f/os-volume_attachments/5132fb80-003c-40ef-890f-b5af65110b5e" status: 200 len: 194 microversion: 2.20 time: 0.046327 Jul 07 10:34:02.980568 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 390/800] 10.222.0.16 () {60 vars in 1453 bytes} [Thu Jul 7 10:34:02 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f/os-volume_attachments/5132fb80-003c-40ef-890f-b5af65110b5e => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 10:34:03.045610 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-275897f9-c136-435f-b9bb-a3a78e1614af tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:03.046223 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-275897f9-c136-435f-b9bb-a3a78e1614af tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:03.048696 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:34:03.049439 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:34:03.055323 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-275897f9-c136-435f-b9bb-a3a78e1614af tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:03.055802 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-275897f9-c136-435f-b9bb-a3a78e1614af tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:03.056575 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-275897f9-c136-435f-b9bb-a3a78e1614af tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:03.057014 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-275897f9-c136-435f-b9bb-a3a78e1614af tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:03.140118 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.objects.instance [None req-275897f9-c136-435f-b9bb-a3a78e1614af tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lazy-loading 'services' on Instance uuid b52e1947-1b4e-4a83-9041-ea3b84be027f {{(pid=117646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 10:34:03.208592 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-275897f9-c136-435f-b9bb-a3a78e1614af tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f/os-volume_attachments/5132fb80-003c-40ef-890f-b5af65110b5e" status: 202 len: 0 microversion: 2.20 time: 0.167701 Jul 07 10:34:03.209329 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 411/801] 10.222.0.16 () {60 vars in 1456 bytes} [Thu Jul 7 10:34:03 2022] DELETE /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f/os-volume_attachments/5132fb80-003c-40ef-890f-b5af65110b5e => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 07 10:34:03.218273 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d7596411-f0e0-4b92-8fd1-e24adebd4629 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:03.219194 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d7596411-f0e0-4b92-8fd1-e24adebd4629 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:03.225753 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d7596411-f0e0-4b92-8fd1-e24adebd4629 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:03.226377 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d7596411-f0e0-4b92-8fd1-e24adebd4629 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:03.227318 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d7596411-f0e0-4b92-8fd1-e24adebd4629 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:03.228472 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d7596411-f0e0-4b92-8fd1-e24adebd4629 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:03.261866 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d7596411-f0e0-4b92-8fd1-e24adebd4629 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047659 Jul 07 10:34:03.262411 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 391/802] 10.222.0.16 () {60 vars in 1342 bytes} [Thu Jul 7 10:34:03 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 10:34:04.274630 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-3672b2b0-3f6f-424e-8a2d-73850578e9a7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:04.275586 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-3672b2b0-3f6f-424e-8a2d-73850578e9a7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:04.281860 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3672b2b0-3f6f-424e-8a2d-73850578e9a7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:04.282322 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3672b2b0-3f6f-424e-8a2d-73850578e9a7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:04.283117 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3672b2b0-3f6f-424e-8a2d-73850578e9a7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:04.283561 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3672b2b0-3f6f-424e-8a2d-73850578e9a7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:04.312346 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-3672b2b0-3f6f-424e-8a2d-73850578e9a7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042581 Jul 07 10:34:04.312896 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 412/803] 10.222.0.16 () {60 vars in 1342 bytes} [Thu Jul 7 10:34:04 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:34:04.368350 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-f2f98487-d1d4-4b77-8598-88a829625542 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:04.369445 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-f2f98487-d1d4-4b77-8598-88a829625542 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:04.375852 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f2f98487-d1d4-4b77-8598-88a829625542 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:04.376304 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f2f98487-d1d4-4b77-8598-88a829625542 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:04.377058 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f2f98487-d1d4-4b77-8598-88a829625542 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:04.377491 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f2f98487-d1d4-4b77-8598-88a829625542 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:04.401994 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-f2f98487-d1d4-4b77-8598-88a829625542 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Going to try to terminate instance {{(pid=117647) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 10:34:04.474042 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-f2f98487-d1d4-4b77-8598-88a829625542 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 204 len: 0 microversion: 2.20 time: 0.109236 Jul 07 10:34:04.474622 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 392/804] 10.222.0.16 () {60 vars in 1279 bytes} [Thu Jul 7 10:34:04 2022] DELETE /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 07 10:34:04.483306 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-c17c1fb1-26fd-4e02-a23d-b03f8cef0632 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:04.483938 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-c17c1fb1-26fd-4e02-a23d-b03f8cef0632 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:04.489801 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c17c1fb1-26fd-4e02-a23d-b03f8cef0632 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:04.490249 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c17c1fb1-26fd-4e02-a23d-b03f8cef0632 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:04.491009 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c17c1fb1-26fd-4e02-a23d-b03f8cef0632 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:04.491444 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c17c1fb1-26fd-4e02-a23d-b03f8cef0632 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:04.624650 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-c17c1fb1-26fd-4e02-a23d-b03f8cef0632 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:04.632522 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-c17c1fb1-26fd-4e02-a23d-b03f8cef0632 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:04.634008 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-c17c1fb1-26fd-4e02-a23d-b03f8cef0632 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:04.635180 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-c17c1fb1-26fd-4e02-a23d-b03f8cef0632 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1723 microversion: 2.20 time: 0.155743 Jul 07 10:34:04.635731 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 413/805] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:34:04 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:34:05.653886 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-65bf3dd4-0d82-4a5b-bca1-bdd22321e90c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:05.654591 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-65bf3dd4-0d82-4a5b-bca1-bdd22321e90c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:05.661088 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-65bf3dd4-0d82-4a5b-bca1-bdd22321e90c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:05.661540 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-65bf3dd4-0d82-4a5b-bca1-bdd22321e90c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:05.662308 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-65bf3dd4-0d82-4a5b-bca1-bdd22321e90c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:05.662749 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-65bf3dd4-0d82-4a5b-bca1-bdd22321e90c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:05.792922 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-65bf3dd4-0d82-4a5b-bca1-bdd22321e90c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:05.800752 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-65bf3dd4-0d82-4a5b-bca1-bdd22321e90c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:05.802246 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-65bf3dd4-0d82-4a5b-bca1-bdd22321e90c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:05.803400 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-65bf3dd4-0d82-4a5b-bca1-bdd22321e90c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1723 microversion: 2.20 time: 0.153861 Jul 07 10:34:05.803987 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 393/806] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:34:05 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:34:06.822688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-7c24e46f-6525-4536-8082-923c6fd0f44f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:06.823331 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-7c24e46f-6525-4536-8082-923c6fd0f44f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:06.829883 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7c24e46f-6525-4536-8082-923c6fd0f44f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:06.830332 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7c24e46f-6525-4536-8082-923c6fd0f44f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:06.831104 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7c24e46f-6525-4536-8082-923c6fd0f44f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:06.831539 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7c24e46f-6525-4536-8082-923c6fd0f44f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:06.892836 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-7c24e46f-6525-4536-8082-923c6fd0f44f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:06.900661 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-7c24e46f-6525-4536-8082-923c6fd0f44f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:06.902177 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-7c24e46f-6525-4536-8082-923c6fd0f44f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:06.903328 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-7c24e46f-6525-4536-8082-923c6fd0f44f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 200 len: 1655 microversion: 2.20 time: 0.085120 Jul 07 10:34:06.903903 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 414/807] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:34:06 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 1655 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:34:07.017928 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-0302a46c-f18d-4027-b1db-4dd5a4123c7f req-acf2ab0f-1705-415a-b9bd-174cb4c7c8ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b52e1947-1b4e-4a83-9041-ea3b84be027f", "name": "network-vif-deleted", "tag": "ec13cec0-c49a-4b4e-b223-9bc0ab7b4152"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:34:07.025889 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-0302a46c-f18d-4027-b1db-4dd5a4123c7f req-acf2ab0f-1705-415a-b9bd-174cb4c7c8ac service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:07.026336 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-0302a46c-f18d-4027-b1db-4dd5a4123c7f req-acf2ab0f-1705-415a-b9bd-174cb4c7c8ac service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:07.038229 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-0302a46c-f18d-4027-b1db-4dd5a4123c7f req-acf2ab0f-1705-415a-b9bd-174cb4c7c8ac service nova] Creating event network-vif-deleted:ec13cec0-c49a-4b4e-b223-9bc0ab7b4152 for instance b52e1947-1b4e-4a83-9041-ea3b84be027f on hv-cinder-82282 Jul 07 10:34:07.043168 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-0302a46c-f18d-4027-b1db-4dd5a4123c7f req-acf2ab0f-1705-415a-b9bd-174cb4c7c8ac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032602 Jul 07 10:34:07.044114 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 394/808] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:34:07.921354 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-0fd83961-3db3-4895-94ce-2283ad389c39 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:07.921971 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-0fd83961-3db3-4895-94ce-2283ad389c39 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:07.928718 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0fd83961-3db3-4895-94ce-2283ad389c39 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:07.929172 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0fd83961-3db3-4895-94ce-2283ad389c39 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:07.929945 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0fd83961-3db3-4895-94ce-2283ad389c39 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:07.930383 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0fd83961-3db3-4895-94ce-2283ad389c39 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:07.943702 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.wsgi [None req-0fd83961-3db3-4895-94ce-2283ad389c39 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] HTTP exception thrown: Instance b52e1947-1b4e-4a83-9041-ea3b84be027f could not be found. Jul 07 10:34:07.945361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-0fd83961-3db3-4895-94ce-2283ad389c39 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Request method failure captured: Jul 07 10:34:07.945361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f HTTP/1.1 Jul 07 10:34:07.945361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:34:07.945361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:34:07.945361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:34:07.945361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 0 Jul 07 10:34:07.945361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:34:07.945361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:34:07.945361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:34:07.945361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:34:07.945361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrYEuYwKPnkljHRk0_LP-3RppqXYxDJn2lNWAJneOsf-lRx6WT0_NrypbEEQSItWaO3W8cpEmzNT5WjpjEAPB0TQbNcPkt25V_LEh4yiglMFXVSxfL_2uZcHY4WokoEvFeWe4OUptx5h-iDEfigAwq3jSzFUZu6eeEoLElUei2R-6iQ Jul 07 10:34:07.945361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:34:07.945361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:34:07.945361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:34:07.945361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:34:07.945361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Openstack-Nova-Api-Version: 2.20 Jul 07 10:34:07.945361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:34:07.945361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:34:07.945361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: 96923df6a03841498e3732c8504b6363 Jul 07 10:34:07.945361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1231301553 Jul 07 10:34:07.945361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:34:07.945361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:34:07.947646 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96923df6a03841498e3732c8504b6363"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96923df6a03841498e3732c8504b6363"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96923df6a03841498e3732c8504b6363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96923df6a03841498e3732c8504b6363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:34:07.947646 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1231301553 Jul 07 10:34:07.947646 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: 96923df6a03841498e3732c8504b6363 Jul 07 10:34:07.947646 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1231301553 Jul 07 10:34:07.947646 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-AttachVolumeShelveTestJSON-1231301553-project Jul 07 10:34:07.947646 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:34:07.947646 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:34:07.947646 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: 31bcb5c27d8b4ae2b9a3207fff0eabfe Jul 07 10:34:07.947646 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1231301553-project Jul 07 10:34:07.947646 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: > Jul 07 10:34:07.947646 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Instance b52e1947-1b4e-4a83-9041-ea3b84be027f could not be found. Jul 07 10:34:07.947646 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'id': 'b52e1947-1b4e-4a83-9041-ea3b84be027f'} Jul 07 10:34:07.948758 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:34:07.948758 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:34:07.948758 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:34:07.948758 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:34:07.948758 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:34:07.948758 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:34:07.948758 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:34:07.948758 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:34:07.948758 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:34:07.948758 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:34:07.948758 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b52e1947-1b4e-4a83-9041-ea3b84be027f could not be found. Jul 07 10:34:07.948758 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:34:07.948758 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:34:07.948758 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:34:07.948758 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:34:07.948758 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:34:07.948758 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:34:07.948758 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:34:07.948758 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:34:07.948758 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:34:07.950211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:34:07.950211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:34:07.950211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:34:07.950211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:34:07.950211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:34:07.950211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:34:07.950211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:34:07.950211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b52e1947-1b4e-4a83-9041-ea3b84be027f could not be found. Jul 07 10:34:07.950211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:34:07.950211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:34:07.950211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:34:07.950211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:34:07.950211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:34:07.950211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:34:07.950211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:34:07.950211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:34:07.950211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b52e1947-1b4e-4a83-9041-ea3b84be027f could not be found. Jul 07 10:34:07.950211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:34:07.951553 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-0fd83961-3db3-4895-94ce-2283ad389c39 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Returning 404 to user: Instance b52e1947-1b4e-4a83-9041-ea3b84be027f could not be found. {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:34:07.951553 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-0fd83961-3db3-4895-94ce-2283ad389c39 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 404 len: 111 microversion: 2.20 time: 0.029315 Jul 07 10:34:07.951553 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 415/809] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:34:07 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 07 10:34:07.956651 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-45e986ff-b341-473f-b12b-e3a9ae998fba tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '.version_select at 0x7f9e9e493670>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:07.975384 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-45e986ff-b341-473f-b12b-e3a9ae998fba tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-777105580" status: 204 len: 0 microversion: 2.20 time: 0.022915 Jul 07 10:34:07.975993 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 395/810] 10.222.0.16 () {60 vars in 1258 bytes} [Thu Jul 7 10:34:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-777105580 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 07 10:34:08.583033 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-18f109af-331e-4353-8333-b353792960d2 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Action: 'create', calling method: .version_select at 0x7f9e9e396ee0>, body: {"keypair": {"name": "tempest-keypair-1120094088", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdVHYWQkrsfSkFlKIKncc+f/l/W9i0pITHSKTfE0zV+IFKBsLyU5sj+ETw21jvwvJ4KetDc0PNDfjZ1YUR6jxsNRzE/DrhswzdBHdjhHyHQe2MN0e/OJ7ppd0wwQx/Lfg=="}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:34:08.597183 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-18f109af-331e-4353-8333-b353792960d2 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Getting quotas for project 96923df6a03841498e3732c8504b6363. Resources: {'key_pairs'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:34:08.600954 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-18f109af-331e-4353-8333-b353792960d2 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Getting quotas for user 31bcb5c27d8b4ae2b9a3207fff0eabfe and project 96923df6a03841498e3732c8504b6363. Resources: {'key_pairs'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:34:08.621192 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-18f109af-331e-4353-8333-b353792960d2 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.042169 Jul 07 10:34:08.621757 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 416/811] 10.222.0.16 () {62 vars in 1199 bytes} [Thu Jul 7 10:34:08 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 43 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 07 10:34:09.851122 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d624c0d1-857a-4837-86ab-ea098b82fbc0 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1007054529", "imageRef": "1c96509d-f65f-42b0-94b3-6fc590a93508", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "996996e9-2cfe-410c-9ecf-b4537a28c022"}], "security_groups": [{"name": "tempest-securitygroup--216494377"}], "key_name": "tempest-keypair-1120094088", "user_data": "}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:34:09.951288 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.network.neutron [None req-d624c0d1-857a-4837-86ab-ea098b82fbc0 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] validate_networks() for [('996996e9-2cfe-410c-9ecf-b4537a28c022', None, None, None, None, None)] {{(pid=117647) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 10:34:10.304407 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-d624c0d1-857a-4837-86ab-ea098b82fbc0 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Flavor limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 10:34:10.304838 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-d624c0d1-857a-4837-86ab-ea098b82fbc0 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Image limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 10:34:10.305317 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-d624c0d1-857a-4837-86ab-ea098b82fbc0 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Flavor pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 10:34:10.305727 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-d624c0d1-857a-4837-86ab-ea098b82fbc0 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Image pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 10:34:10.306897 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-d624c0d1-857a-4837-86ab-ea098b82fbc0 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 10:34:10.315696 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d624c0d1-857a-4837-86ab-ea098b82fbc0 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:10.316174 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d624c0d1-857a-4837-86ab-ea098b82fbc0 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:10.317232 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d624c0d1-857a-4837-86ab-ea098b82fbc0 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:10.317675 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d624c0d1-857a-4837-86ab-ea098b82fbc0 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:10.333900 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-d624c0d1-857a-4837-86ab-ea098b82fbc0 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Getting quotas for project 96923df6a03841498e3732c8504b6363. Resources: {'cores', 'ram', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:34:10.337886 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-d624c0d1-857a-4837-86ab-ea098b82fbc0 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Getting quotas for user 31bcb5c27d8b4ae2b9a3207fff0eabfe and project 96923df6a03841498e3732c8504b6363. Resources: {'cores', 'ram', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:34:10.349567 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d624c0d1-857a-4837-86ab-ea098b82fbc0 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Going to run 1 instances... {{(pid=117647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 10:34:10.351921 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d624c0d1-857a-4837-86ab-ea098b82fbc0 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c96509d-f65f-42b0-94b3-6fc590a93508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 10:34:10.397340 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d624c0d1-857a-4837-86ab-ea098b82fbc0 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.550482 Jul 07 10:34:10.397992 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 396/812] 10.222.0.16 () {62 vars in 1187 bytes} [Thu Jul 7 10:34:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 07 10:34:10.408521 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-f57bdb5f-6af3-4e0b-b397-b799557cf8f9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:10.409165 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-f57bdb5f-6af3-4e0b-b397-b799557cf8f9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:10.466553 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-f57bdb5f-6af3-4e0b-b397-b799557cf8f9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:10.473627 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-f57bdb5f-6af3-4e0b-b397-b799557cf8f9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:10.475137 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-f57bdb5f-6af3-4e0b-b397-b799557cf8f9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:10.476301 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-f57bdb5f-6af3-4e0b-b397-b799557cf8f9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1282 microversion: 2.20 time: 0.072257 Jul 07 10:34:10.476849 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 417/813] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:34:10 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1282 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:34:11.494970 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a1da66cd-17f5-40ab-8272-8924f18b30ce tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:11.495581 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a1da66cd-17f5-40ab-8272-8924f18b30ce tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:11.502935 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a1da66cd-17f5-40ab-8272-8924f18b30ce tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:11.503392 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a1da66cd-17f5-40ab-8272-8924f18b30ce tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:11.504205 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a1da66cd-17f5-40ab-8272-8924f18b30ce tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:11.504651 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a1da66cd-17f5-40ab-8272-8924f18b30ce tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:11.573053 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a1da66cd-17f5-40ab-8272-8924f18b30ce tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:11.581123 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a1da66cd-17f5-40ab-8272-8924f18b30ce tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:11.582627 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a1da66cd-17f5-40ab-8272-8924f18b30ce tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:11.583737 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a1da66cd-17f5-40ab-8272-8924f18b30ce tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1340 microversion: 2.20 time: 0.093282 Jul 07 10:34:11.584311 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 397/814] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:34:11 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1340 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:34:12.601556 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-245e40e9-95f5-404f-8ddb-9c8bb212318c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:12.602160 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-245e40e9-95f5-404f-8ddb-9c8bb212318c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:12.608552 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-245e40e9-95f5-404f-8ddb-9c8bb212318c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:12.609004 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-245e40e9-95f5-404f-8ddb-9c8bb212318c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:12.609764 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-245e40e9-95f5-404f-8ddb-9c8bb212318c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:12.610207 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-245e40e9-95f5-404f-8ddb-9c8bb212318c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:12.752196 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-245e40e9-95f5-404f-8ddb-9c8bb212318c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:12.761482 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-245e40e9-95f5-404f-8ddb-9c8bb212318c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:12.763564 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-245e40e9-95f5-404f-8ddb-9c8bb212318c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:12.764917 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-245e40e9-95f5-404f-8ddb-9c8bb212318c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1407 microversion: 2.20 time: 0.167296 Jul 07 10:34:12.765578 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 418/815] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:34:12 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:34:12.902310 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-15939a74-ec93-408b-ba5c-8a816aca15e9 req-2dfe2980-6bd2-4ee0-97c8-4b8bd626da4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e66414c-2b54-4dcf-822c-96e90792fac7", "tag": "c7f05a17-2bf9-4c26-b60c-bf7c44c7df40"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:34:12.913941 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-15939a74-ec93-408b-ba5c-8a816aca15e9 req-2dfe2980-6bd2-4ee0-97c8-4b8bd626da4b service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:12.914406 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-15939a74-ec93-408b-ba5c-8a816aca15e9 req-2dfe2980-6bd2-4ee0-97c8-4b8bd626da4b service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:12.934846 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-15939a74-ec93-408b-ba5c-8a816aca15e9 req-2dfe2980-6bd2-4ee0-97c8-4b8bd626da4b service nova] Creating event network-changed:c7f05a17-2bf9-4c26-b60c-bf7c44c7df40 for instance 0e66414c-2b54-4dcf-822c-96e90792fac7 on hv-cinder-82282 Jul 07 10:34:12.939965 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-15939a74-ec93-408b-ba5c-8a816aca15e9 req-2dfe2980-6bd2-4ee0-97c8-4b8bd626da4b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041193 Jul 07 10:34:12.941156 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 398/816] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:34:13.782543 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-8d281c7c-cbdc-4267-b9b7-177da86f541e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:13.783153 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-8d281c7c-cbdc-4267-b9b7-177da86f541e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:13.789708 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8d281c7c-cbdc-4267-b9b7-177da86f541e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:13.790819 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8d281c7c-cbdc-4267-b9b7-177da86f541e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:13.791583 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8d281c7c-cbdc-4267-b9b7-177da86f541e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:13.792054 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8d281c7c-cbdc-4267-b9b7-177da86f541e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:13.921294 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-8d281c7c-cbdc-4267-b9b7-177da86f541e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:13.929290 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-8d281c7c-cbdc-4267-b9b7-177da86f541e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:13.930760 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-8d281c7c-cbdc-4267-b9b7-177da86f541e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:13.932009 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-8d281c7c-cbdc-4267-b9b7-177da86f541e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1407 microversion: 2.20 time: 0.153302 Jul 07 10:34:13.932484 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 419/817] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:34:13 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:34:14.951636 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-beb81211-d0a3-4cde-b80b-a740a79ce6ab tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:14.952366 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-beb81211-d0a3-4cde-b80b-a740a79ce6ab tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:14.958577 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-beb81211-d0a3-4cde-b80b-a740a79ce6ab tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:14.959022 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-beb81211-d0a3-4cde-b80b-a740a79ce6ab tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:14.959804 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-beb81211-d0a3-4cde-b80b-a740a79ce6ab tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:14.960243 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-beb81211-d0a3-4cde-b80b-a740a79ce6ab tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:15.092597 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-beb81211-d0a3-4cde-b80b-a740a79ce6ab tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:15.100511 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-beb81211-d0a3-4cde-b80b-a740a79ce6ab tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:15.102014 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-beb81211-d0a3-4cde-b80b-a740a79ce6ab tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:15.103285 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-beb81211-d0a3-4cde-b80b-a740a79ce6ab tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1407 microversion: 2.20 time: 0.157242 Jul 07 10:34:15.103863 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 399/818] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:34:14 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:34:16.121452 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-845de82e-d32c-453f-8989-af6c0a495a15 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:16.122061 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-845de82e-d32c-453f-8989-af6c0a495a15 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:16.128561 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-845de82e-d32c-453f-8989-af6c0a495a15 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:16.129013 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-845de82e-d32c-453f-8989-af6c0a495a15 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:16.129772 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-845de82e-d32c-453f-8989-af6c0a495a15 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:16.130205 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-845de82e-d32c-453f-8989-af6c0a495a15 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:16.257759 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-845de82e-d32c-453f-8989-af6c0a495a15 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:16.266043 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-845de82e-d32c-453f-8989-af6c0a495a15 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:16.267535 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-845de82e-d32c-453f-8989-af6c0a495a15 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:16.268658 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-845de82e-d32c-453f-8989-af6c0a495a15 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1407 microversion: 2.20 time: 0.151758 Jul 07 10:34:16.269205 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 420/819] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:34:16 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:34:17.287452 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-99bb6e8e-8515-4b2d-a80a-30e7cf6acc2d tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:17.288014 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-99bb6e8e-8515-4b2d-a80a-30e7cf6acc2d tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:17.296089 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-99bb6e8e-8515-4b2d-a80a-30e7cf6acc2d tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:17.296538 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-99bb6e8e-8515-4b2d-a80a-30e7cf6acc2d tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:17.297459 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-99bb6e8e-8515-4b2d-a80a-30e7cf6acc2d tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:17.297899 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-99bb6e8e-8515-4b2d-a80a-30e7cf6acc2d tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:17.424375 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-99bb6e8e-8515-4b2d-a80a-30e7cf6acc2d tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:17.432254 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-99bb6e8e-8515-4b2d-a80a-30e7cf6acc2d tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:17.433746 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-99bb6e8e-8515-4b2d-a80a-30e7cf6acc2d tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:17.434846 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-99bb6e8e-8515-4b2d-a80a-30e7cf6acc2d tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1407 microversion: 2.20 time: 0.151432 Jul 07 10:34:17.435383 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 400/820] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:34:17 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:34:18.452355 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-eefba6e8-7184-4562-a3fa-034f76fb70e3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:18.452895 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-eefba6e8-7184-4562-a3fa-034f76fb70e3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:18.459468 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-eefba6e8-7184-4562-a3fa-034f76fb70e3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:18.459977 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-eefba6e8-7184-4562-a3fa-034f76fb70e3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:18.460743 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-eefba6e8-7184-4562-a3fa-034f76fb70e3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:18.461188 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-eefba6e8-7184-4562-a3fa-034f76fb70e3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:18.589025 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-eefba6e8-7184-4562-a3fa-034f76fb70e3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:18.596801 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-eefba6e8-7184-4562-a3fa-034f76fb70e3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:18.598310 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-eefba6e8-7184-4562-a3fa-034f76fb70e3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:18.599422 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-eefba6e8-7184-4562-a3fa-034f76fb70e3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1407 microversion: 2.20 time: 0.151068 Jul 07 10:34:18.599992 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 421/821] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:34:18 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:34:19.141626 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-e30eb843-903d-4074-bea6-c4ca122c7f90 req-52a6821c-50c8-4c73-a093-348547f9b139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e66414c-2b54-4dcf-822c-96e90792fac7", "name": "network-vif-plugged", "status": "completed", "tag": "c7f05a17-2bf9-4c26-b60c-bf7c44c7df40"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:34:19.151136 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-e30eb843-903d-4074-bea6-c4ca122c7f90 req-52a6821c-50c8-4c73-a093-348547f9b139 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:19.151595 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-e30eb843-903d-4074-bea6-c4ca122c7f90 req-52a6821c-50c8-4c73-a093-348547f9b139 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:19.162874 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-e30eb843-903d-4074-bea6-c4ca122c7f90 req-52a6821c-50c8-4c73-a093-348547f9b139 service nova] Creating event network-vif-plugged:c7f05a17-2bf9-4c26-b60c-bf7c44c7df40 for instance 0e66414c-2b54-4dcf-822c-96e90792fac7 on hv-cinder-82282 Jul 07 10:34:19.167807 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-e30eb843-903d-4074-bea6-c4ca122c7f90 req-52a6821c-50c8-4c73-a093-348547f9b139 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029911 Jul 07 10:34:19.168484 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 401/822] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:34:19.616668 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-16bd10e6-19a2-4f9f-94f2-14cf64244108 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:19.617340 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-16bd10e6-19a2-4f9f-94f2-14cf64244108 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:19.623834 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-16bd10e6-19a2-4f9f-94f2-14cf64244108 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:19.624278 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-16bd10e6-19a2-4f9f-94f2-14cf64244108 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:19.625041 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-16bd10e6-19a2-4f9f-94f2-14cf64244108 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:19.625483 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-16bd10e6-19a2-4f9f-94f2-14cf64244108 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:19.753110 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-16bd10e6-19a2-4f9f-94f2-14cf64244108 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:19.760980 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-16bd10e6-19a2-4f9f-94f2-14cf64244108 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:19.762519 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-16bd10e6-19a2-4f9f-94f2-14cf64244108 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:19.763650 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-16bd10e6-19a2-4f9f-94f2-14cf64244108 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1407 microversion: 2.20 time: 0.150854 Jul 07 10:34:19.764232 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 422/823] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:34:19 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:34:20.779199 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:34:20.779957 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=6 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:34:20.783967 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-57d1a96c-9e40-4bf9-a2b1-106d3b5f9134 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:20.784651 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-57d1a96c-9e40-4bf9-a2b1-106d3b5f9134 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:20.791678 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-57d1a96c-9e40-4bf9-a2b1-106d3b5f9134 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:20.792180 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-57d1a96c-9e40-4bf9-a2b1-106d3b5f9134 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:20.792939 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-57d1a96c-9e40-4bf9-a2b1-106d3b5f9134 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:20.793374 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-57d1a96c-9e40-4bf9-a2b1-106d3b5f9134 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:20.926131 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-57d1a96c-9e40-4bf9-a2b1-106d3b5f9134 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:20.935489 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-57d1a96c-9e40-4bf9-a2b1-106d3b5f9134 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:20.937019 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-57d1a96c-9e40-4bf9-a2b1-106d3b5f9134 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:20.938127 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-57d1a96c-9e40-4bf9-a2b1-106d3b5f9134 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1407 microversion: 2.20 time: 0.160427 Jul 07 10:34:20.939154 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 402/824] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:34:20 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:34:21.956727 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-7528964e-a457-419b-a7dd-bdcea8683789 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:21.957248 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-7528964e-a457-419b-a7dd-bdcea8683789 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:21.959175 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell0:SELECT=6 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:34:21.965520 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7528964e-a457-419b-a7dd-bdcea8683789 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:21.965975 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7528964e-a457-419b-a7dd-bdcea8683789 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:21.966736 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7528964e-a457-419b-a7dd-bdcea8683789 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:21.967178 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7528964e-a457-419b-a7dd-bdcea8683789 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:22.093912 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-7528964e-a457-419b-a7dd-bdcea8683789 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:22.102017 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-7528964e-a457-419b-a7dd-bdcea8683789 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:22.103530 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-7528964e-a457-419b-a7dd-bdcea8683789 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:22.104719 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-7528964e-a457-419b-a7dd-bdcea8683789 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1598 microversion: 2.20 time: 0.151983 Jul 07 10:34:22.105272 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 423/825] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:34:21 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:34:22.121861 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b6387550-0e67-4a2d-bf67-0d394e64a572 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:22.122346 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b6387550-0e67-4a2d-bf67-0d394e64a572 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:22.128754 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b6387550-0e67-4a2d-bf67-0d394e64a572 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:22.129199 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b6387550-0e67-4a2d-bf67-0d394e64a572 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:22.129946 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b6387550-0e67-4a2d-bf67-0d394e64a572 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:22.130377 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b6387550-0e67-4a2d-bf67-0d394e64a572 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:22.210995 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b6387550-0e67-4a2d-bf67-0d394e64a572 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093057 Jul 07 10:34:22.211624 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 403/826] 10.222.0.16 () {60 vars in 1315 bytes} [Thu Jul 7 10:34:22 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 10:34:23.116601 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-e8868d54-1f66-4ce2-b498-ec542ce00e35 req-eafe6ae1-a523-4e73-8f37-7886df611800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e66414c-2b54-4dcf-822c-96e90792fac7", "tag": "c7f05a17-2bf9-4c26-b60c-bf7c44c7df40"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:34:23.125219 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-e8868d54-1f66-4ce2-b498-ec542ce00e35 req-eafe6ae1-a523-4e73-8f37-7886df611800 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:23.125660 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-e8868d54-1f66-4ce2-b498-ec542ce00e35 req-eafe6ae1-a523-4e73-8f37-7886df611800 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:23.136137 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-e8868d54-1f66-4ce2-b498-ec542ce00e35 req-eafe6ae1-a523-4e73-8f37-7886df611800 service nova] Creating event network-changed:c7f05a17-2bf9-4c26-b60c-bf7c44c7df40 for instance 0e66414c-2b54-4dcf-822c-96e90792fac7 on hv-cinder-82282 Jul 07 10:34:23.141340 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-e8868d54-1f66-4ce2-b498-ec542ce00e35 req-eafe6ae1-a523-4e73-8f37-7886df611800 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028486 Jul 07 10:34:23.142015 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 424/827] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:34:26.442774 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e5edd20c-7c8f-4bd5-9dc6-b86290ed7d35 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:26.443397 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e5edd20c-7c8f-4bd5-9dc6-b86290ed7d35 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:26.450019 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e5edd20c-7c8f-4bd5-9dc6-b86290ed7d35 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:26.450469 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e5edd20c-7c8f-4bd5-9dc6-b86290ed7d35 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:26.451227 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e5edd20c-7c8f-4bd5-9dc6-b86290ed7d35 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:26.451666 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e5edd20c-7c8f-4bd5-9dc6-b86290ed7d35 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:26.473959 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e5edd20c-7c8f-4bd5-9dc6-b86290ed7d35 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f/ips" status: 200 len: 149 microversion: 2.1 time: 0.035854 Jul 07 10:34:26.474514 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 404/828] 10.222.0.16 () {58 vars in 1247 bytes} [Thu Jul 7 10:34:26 2022] GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:34:26.486816 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-b598c03e-1d11-423b-8545-5f60a87ababc tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bea583e7-7d69-41bc-9d27-68edb95d9f91"}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:34:26.487992 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-b598c03e-1d11-423b-8545-5f60a87ababc tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:26.494666 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b598c03e-1d11-423b-8545-5f60a87ababc tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:26.495123 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b598c03e-1d11-423b-8545-5f60a87ababc tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:26.495918 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b598c03e-1d11-423b-8545-5f60a87ababc tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:26.496366 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b598c03e-1d11-423b-8545-5f60a87ababc tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:26.573971 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.wsgi [None req-b598c03e-1d11-423b-8545-5f60a87ababc tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] HTTP exception thrown: Invalid volume: volume bea583e7-7d69-41bc-9d27-68edb95d9f91 is already attached to instances: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12 Jul 07 10:34:26.575698 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-b598c03e-1d11-423b-8545-5f60a87ababc tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Request method failure captured: Jul 07 10:34:26.575698 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: POST /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f/os-volume_attachments HTTP/1.1 Jul 07 10:34:26.575698 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:34:26.575698 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:34:26.575698 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:34:26.575698 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 74 Jul 07 10:34:26.575698 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:34:26.575698 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:34:26.575698 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:34:26.575698 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:34:26.575698 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrY8OvCBMJnjRdOGiniYdWVQXRU5j_oL_-3IW8B050mI9iTiMiAqckVcFrYUNMDNBzu5A7KjWAw4CfsePxF_lhVKdStuWP73EE48s908WgfQ_p-BUvui7Lff6JDUFqsZcmbVchhpCEcFgE514wUYqWgw2aG015Cpl2jakkhdOE3Gcxc Jul 07 10:34:26.575698 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:34:26.575698 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:34:26.575698 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:34:26.575698 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:34:26.575698 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:34:26.575698 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:34:26.575698 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: 1568d5b1c4bb471f9de53f4d5cf7cc82 Jul 07 10:34:26.575698 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:34:26.575698 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:34:26.575698 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:34:26.577349 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:34:26.577349 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:34:26.577349 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: 1568d5b1c4bb471f9de53f4d5cf7cc82 Jul 07 10:34:26.577349 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:34:26.577349 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-AttachVolumeNegativeTest-1710795981-project Jul 07 10:34:26.577349 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:34:26.577349 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:34:26.577349 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: 1222d8bb50554d64ac674f109b6ad077 Jul 07 10:34:26.577349 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-AttachVolumeNegativeTest-1710795981-project Jul 07 10:34:26.577349 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Jul 07 10:34:26.577349 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {"volumeAttachment": {"volumeId": "bea583e7-7d69-41bc-9d27-68edb95d9f91"}} Jul 07 10:34:26.577349 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: > Jul 07 10:34:26.578430 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Invalid volume: volume bea583e7-7d69-41bc-9d27-68edb95d9f91 is already attached to instances: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12 Jul 07 10:34:26.578430 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'server_id': 'd5937bd8-b378-4d9a-b96b-14e1d7d3cb6f', 'body': {'volumeAttachment': {'volumeId': 'bea583e7-7d69-41bc-9d27-68edb95d9f91'}}} Jul 07 10:34:26.578430 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:34:26.578430 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:34:26.578430 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 07 10:34:26.578430 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 07 10:34:26.578430 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 07 10:34:26.578430 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 07 10:34:26.578430 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 07 10:34:26.578430 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 07 10:34:26.578430 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 07 10:34:26.578430 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 07 10:34:26.578430 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 07 10:34:26.578430 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 07 10:34:26.578430 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bea583e7-7d69-41bc-9d27-68edb95d9f91 is already attached to instances: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12 Jul 07 10:34:26.578430 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:34:26.578430 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:34:26.578430 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:34:26.578430 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:34:26.580140 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:34:26.580140 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:34:26.580140 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:34:26.580140 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:34:26.580140 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:34:26.580140 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:34:26.580140 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 10:34:26.580140 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 10:34:26.580140 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 10:34:26.580140 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 10:34:26.580140 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 10:34:26.580140 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 10:34:26.580140 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 07 10:34:26.580140 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 07 10:34:26.580140 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bea583e7-7d69-41bc-9d27-68edb95d9f91 is already attached to instances: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12 Jul 07 10:34:26.580140 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:34:26.580140 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:34:26.580140 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:34:26.580140 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:34:26.580140 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:34:26.581824 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:34:26.581824 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:34:26.581824 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:34:26.581824 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bea583e7-7d69-41bc-9d27-68edb95d9f91 is already attached to instances: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12 Jul 07 10:34:26.581824 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:34:26.581824 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-b598c03e-1d11-423b-8545-5f60a87ababc tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Returning 400 to user: Invalid volume: volume bea583e7-7d69-41bc-9d27-68edb95d9f91 is already attached to instances: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12 {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:34:26.581824 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-b598c03e-1d11-423b-8545-5f60a87ababc tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "POST /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095378 Jul 07 10:34:26.581824 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 425/829] 10.222.0.16 () {60 vars in 1322 bytes} [Thu Jul 7 10:34:26 2022] POST /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 07 10:34:26.585862 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ef7d04e6-9b28-44df-9b6d-04ad6ae3b555 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:26.586364 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ef7d04e6-9b28-44df-9b6d-04ad6ae3b555 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:26.592361 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ef7d04e6-9b28-44df-9b6d-04ad6ae3b555 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:26.592818 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ef7d04e6-9b28-44df-9b6d-04ad6ae3b555 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:26.594335 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ef7d04e6-9b28-44df-9b6d-04ad6ae3b555 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:26.594782 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ef7d04e6-9b28-44df-9b6d-04ad6ae3b555 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:26.620457 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ef7d04e6-9b28-44df-9b6d-04ad6ae3b555 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f] Going to try to terminate instance {{(pid=117647) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 10:34:26.705798 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ef7d04e6-9b28-44df-9b6d-04ad6ae3b555 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f" status: 204 len: 0 microversion: 2.1 time: 0.123346 Jul 07 10:34:26.706329 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 405/830] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jul 7 10:34:26 2022] DELETE /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 10:34:26.715514 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-c1bedcb3-2d35-4c44-89fc-8ec22f4a3515 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:26.716156 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-c1bedcb3-2d35-4c44-89fc-8ec22f4a3515 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:26.723705 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c1bedcb3-2d35-4c44-89fc-8ec22f4a3515 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:26.724153 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c1bedcb3-2d35-4c44-89fc-8ec22f4a3515 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:26.724926 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c1bedcb3-2d35-4c44-89fc-8ec22f4a3515 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:26.725369 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c1bedcb3-2d35-4c44-89fc-8ec22f4a3515 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:26.884669 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-c1bedcb3-2d35-4c44-89fc-8ec22f4a3515 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:26.892190 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-c1bedcb3-2d35-4c44-89fc-8ec22f4a3515 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f" status: 200 len: 1678 microversion: 2.1 time: 0.181314 Jul 07 10:34:26.892930 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 426/831] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:26 2022] GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f => generated 1678 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:34:27.916424 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-f68c2bae-346f-4f82-a365-fe29354f18dc tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:27.917140 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-f68c2bae-346f-4f82-a365-fe29354f18dc tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:27.925143 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f68c2bae-346f-4f82-a365-fe29354f18dc tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:27.925598 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f68c2bae-346f-4f82-a365-fe29354f18dc tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:27.926370 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f68c2bae-346f-4f82-a365-fe29354f18dc tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:27.926813 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f68c2bae-346f-4f82-a365-fe29354f18dc tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:28.065038 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f68c2bae-346f-4f82-a365-fe29354f18dc tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:28.074972 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-f68c2bae-346f-4f82-a365-fe29354f18dc tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f" status: 200 len: 1678 microversion: 2.1 time: 0.163872 Jul 07 10:34:28.075599 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 406/832] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:27 2022] GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:34:29.092562 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-cf1e7b41-6885-4b15-b82b-9b5189b6e37f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:29.093167 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-cf1e7b41-6885-4b15-b82b-9b5189b6e37f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:29.100121 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-cf1e7b41-6885-4b15-b82b-9b5189b6e37f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:29.100821 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-cf1e7b41-6885-4b15-b82b-9b5189b6e37f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:29.101532 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-cf1e7b41-6885-4b15-b82b-9b5189b6e37f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:29.102733 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-cf1e7b41-6885-4b15-b82b-9b5189b6e37f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:29.170325 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-cf1e7b41-6885-4b15-b82b-9b5189b6e37f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:29.177678 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-cf1e7b41-6885-4b15-b82b-9b5189b6e37f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f" status: 200 len: 1611 microversion: 2.1 time: 0.089023 Jul 07 10:34:29.178237 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 427/833] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:29 2022] GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f => generated 1611 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:34:29.331382 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-df299734-7d32-4bea-abfd-2e8794496cd8 req-5a146f8c-e47e-4e05-8df2-407a8313cb7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f", "name": "network-vif-deleted", "tag": "302e7778-80d4-4a6f-8b2e-60b4176593e4"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:34:29.343326 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-df299734-7d32-4bea-abfd-2e8794496cd8 req-5a146f8c-e47e-4e05-8df2-407a8313cb7f service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:29.344131 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-df299734-7d32-4bea-abfd-2e8794496cd8 req-5a146f8c-e47e-4e05-8df2-407a8313cb7f service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:29.361477 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-df299734-7d32-4bea-abfd-2e8794496cd8 req-5a146f8c-e47e-4e05-8df2-407a8313cb7f service nova] Creating event network-vif-deleted:302e7778-80d4-4a6f-8b2e-60b4176593e4 for instance d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f on hv-cinder-82282 Jul 07 10:34:29.366779 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-df299734-7d32-4bea-abfd-2e8794496cd8 req-5a146f8c-e47e-4e05-8df2-407a8313cb7f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039288 Jul 07 10:34:29.367916 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 407/834] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:34:30.196636 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-e8f0651c-92cf-4362-b457-7fc7a96cb7cf tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:30.197275 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-e8f0651c-92cf-4362-b457-7fc7a96cb7cf tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:30.204121 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e8f0651c-92cf-4362-b457-7fc7a96cb7cf tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:30.204577 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e8f0651c-92cf-4362-b457-7fc7a96cb7cf tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:30.205386 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e8f0651c-92cf-4362-b457-7fc7a96cb7cf tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:30.205826 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e8f0651c-92cf-4362-b457-7fc7a96cb7cf tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:30.219687 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.wsgi [None req-e8f0651c-92cf-4362-b457-7fc7a96cb7cf tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] HTTP exception thrown: Instance d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f could not be found. Jul 07 10:34:30.221244 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-e8f0651c-92cf-4362-b457-7fc7a96cb7cf tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Request method failure captured: Jul 07 10:34:30.221244 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f HTTP/1.1 Jul 07 10:34:30.221244 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:34:30.221244 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:34:30.221244 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:34:30.221244 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 0 Jul 07 10:34:30.221244 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:34:30.221244 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:34:30.221244 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:34:30.221244 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:34:30.221244 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrY8OvCBMJnjRdOGiniYdWVQXRU5j_oL_-3IW8B050mI9iTiMiAqckVcFrYUNMDNBzu5A7KjWAw4CfsePxF_lhVKdStuWP73EE48s908WgfQ_p-BUvui7Lff6JDUFqsZcmbVchhpCEcFgE514wUYqWgw2aG015Cpl2jakkhdOE3Gcxc Jul 07 10:34:30.221244 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:34:30.221244 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:34:30.221244 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:34:30.221244 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:34:30.221244 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:34:30.221244 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:34:30.221244 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: 1568d5b1c4bb471f9de53f4d5cf7cc82 Jul 07 10:34:30.221244 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:34:30.221244 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:34:30.221244 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:34:30.222678 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:34:30.222678 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:34:30.222678 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: 1568d5b1c4bb471f9de53f4d5cf7cc82 Jul 07 10:34:30.222678 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:34:30.222678 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-AttachVolumeNegativeTest-1710795981-project Jul 07 10:34:30.222678 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:34:30.222678 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:34:30.222678 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: 1222d8bb50554d64ac674f109b6ad077 Jul 07 10:34:30.222678 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-AttachVolumeNegativeTest-1710795981-project Jul 07 10:34:30.222678 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: > Jul 07 10:34:30.222678 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Instance d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f could not be found. Jul 07 10:34:30.222678 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'id': 'd5937bd8-b378-4d9a-b96b-14e1d7d3cb6f'} Jul 07 10:34:30.223424 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:34:30.223424 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:34:30.223424 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:34:30.223424 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:34:30.223424 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:34:30.223424 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:34:30.223424 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:34:30.223424 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:34:30.223424 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:34:30.223424 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:34:30.223424 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f could not be found. Jul 07 10:34:30.223424 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:34:30.223424 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:34:30.223424 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:34:30.223424 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:34:30.223424 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:34:30.223424 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:34:30.223424 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:34:30.223424 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:34:30.223424 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:34:30.224685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:34:30.224685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:34:30.224685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:34:30.224685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:34:30.224685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:34:30.224685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:34:30.224685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:34:30.224685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f could not be found. Jul 07 10:34:30.224685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:34:30.224685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:34:30.224685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:34:30.224685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:34:30.224685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:34:30.224685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:34:30.224685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:34:30.224685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:34:30.224685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f could not be found. Jul 07 10:34:30.224685 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:34:30.227101 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-e8f0651c-92cf-4362-b457-7fc7a96cb7cf tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Returning 404 to user: Instance d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f could not be found. {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:34:30.227997 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-e8f0651c-92cf-4362-b457-7fc7a96cb7cf tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f" status: 404 len: 111 microversion: 2.1 time: 0.035982 Jul 07 10:34:30.228560 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 428/835] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:30 2022] GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:34:30.237356 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-90c7a851-b776-4542-925a-34896ccfcfea tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '.version_select at 0x7f9e9e47b430>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:30.258116 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-90c7a851-b776-4542-925a-34896ccfcfea tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-489560912" status: 202 len: 0 microversion: 2.1 time: 0.024153 Jul 07 10:34:30.259330 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 408/836] 10.222.0.16 () {58 vars in 1217 bytes} [Thu Jul 7 10:34:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-489560912 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 10:34:30.955621 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-fb0c6689-5e22-4f86-b6a3-f1f993765580 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:30.956144 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-fb0c6689-5e22-4f86-b6a3-f1f993765580 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:30.962092 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fb0c6689-5e22-4f86-b6a3-f1f993765580 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:30.962549 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fb0c6689-5e22-4f86-b6a3-f1f993765580 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:30.963313 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fb0c6689-5e22-4f86-b6a3-f1f993765580 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:30.963765 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fb0c6689-5e22-4f86-b6a3-f1f993765580 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:31.043268 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.objects.instance [None req-fb0c6689-5e22-4f86-b6a3-f1f993765580 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lazy-loading 'services' on Instance uuid 55b0ddaa-4b4a-4050-a95f-dea6e7754d12 {{(pid=117646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 10:34:31.112146 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-fb0c6689-5e22-4f86-b6a3-f1f993765580 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "DELETE /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12/os-volume_attachments/bea583e7-7d69-41bc-9d27-68edb95d9f91" status: 202 len: 0 microversion: 2.1 time: 0.160149 Jul 07 10:34:31.112719 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 429/837] 10.222.0.16 () {58 vars in 1415 bytes} [Thu Jul 7 10:34:30 2022] DELETE /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12/os-volume_attachments/bea583e7-7d69-41bc-9d27-68edb95d9f91 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 10:34:31.122235 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-536eb055-4170-4cda-81a1-9c894d34a277 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:31.123269 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-536eb055-4170-4cda-81a1-9c894d34a277 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:31.129951 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-536eb055-4170-4cda-81a1-9c894d34a277 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:31.130379 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-536eb055-4170-4cda-81a1-9c894d34a277 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:31.131194 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-536eb055-4170-4cda-81a1-9c894d34a277 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:31.131916 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-536eb055-4170-4cda-81a1-9c894d34a277 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:31.135621 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:34:31.165227 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-536eb055-4170-4cda-81a1-9c894d34a277 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047634 Jul 07 10:34:31.165930 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 409/838] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jul 7 10:34:31 2022] GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:34:32.178541 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-ee65fd93-9771-45af-9734-7c5c3c1168ba tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:32.179594 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-ee65fd93-9771-45af-9734-7c5c3c1168ba tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:32.186276 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ee65fd93-9771-45af-9734-7c5c3c1168ba tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:32.186724 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ee65fd93-9771-45af-9734-7c5c3c1168ba tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:32.187479 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ee65fd93-9771-45af-9734-7c5c3c1168ba tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:32.187942 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ee65fd93-9771-45af-9734-7c5c3c1168ba tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:32.191816 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:34:32.217835 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-ee65fd93-9771-45af-9734-7c5c3c1168ba tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044349 Jul 07 10:34:32.218381 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 430/839] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jul 7 10:34:32 2022] GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:34:33.229265 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-bcea240c-95b4-4921-bff5-ea92bbde3306 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:33.230189 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-bcea240c-95b4-4921-bff5-ea92bbde3306 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:33.232507 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:34:33.237734 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bcea240c-95b4-4921-bff5-ea92bbde3306 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:33.238185 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bcea240c-95b4-4921-bff5-ea92bbde3306 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:33.238948 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bcea240c-95b4-4921-bff5-ea92bbde3306 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:33.239383 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bcea240c-95b4-4921-bff5-ea92bbde3306 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:33.269041 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-bcea240c-95b4-4921-bff5-ea92bbde3306 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044425 Jul 07 10:34:33.269581 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 410/840] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jul 7 10:34:33 2022] GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:34:34.280492 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-b7d3735a-1808-49b2-ad6e-8a14898bc5ef tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:34.281417 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-b7d3735a-1808-49b2-ad6e-8a14898bc5ef tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:34.283870 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:34:34.289891 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b7d3735a-1808-49b2-ad6e-8a14898bc5ef tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:34.290347 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b7d3735a-1808-49b2-ad6e-8a14898bc5ef tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:34.291117 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b7d3735a-1808-49b2-ad6e-8a14898bc5ef tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:34.291558 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b7d3735a-1808-49b2-ad6e-8a14898bc5ef tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:34.321384 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-b7d3735a-1808-49b2-ad6e-8a14898bc5ef tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045109 Jul 07 10:34:34.321946 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 431/841] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jul 7 10:34:34 2022] GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 10:34:34.378070 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a0989ba4-30a1-43cc-ab87-dba57563dcc6 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:34.378555 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a0989ba4-30a1-43cc-ab87-dba57563dcc6 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:34.384972 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a0989ba4-30a1-43cc-ab87-dba57563dcc6 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:34.385420 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a0989ba4-30a1-43cc-ab87-dba57563dcc6 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:34.386198 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a0989ba4-30a1-43cc-ab87-dba57563dcc6 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:34.386632 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a0989ba4-30a1-43cc-ab87-dba57563dcc6 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:34.410638 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a0989ba4-30a1-43cc-ab87-dba57563dcc6 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12] Going to try to terminate instance {{(pid=117647) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 10:34:34.481959 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a0989ba4-30a1-43cc-ab87-dba57563dcc6 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "DELETE /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12" status: 204 len: 0 microversion: 2.1 time: 0.107376 Jul 07 10:34:34.482534 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 411/842] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jul 7 10:34:34 2022] DELETE /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 10:34:34.492285 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-d4c128ce-3fe1-489d-a791-35d696d023ef tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:34.492901 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-d4c128ce-3fe1-489d-a791-35d696d023ef tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:34.499080 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d4c128ce-3fe1-489d-a791-35d696d023ef tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:34.499606 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d4c128ce-3fe1-489d-a791-35d696d023ef tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:34.500403 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d4c128ce-3fe1-489d-a791-35d696d023ef tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:34.500844 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d4c128ce-3fe1-489d-a791-35d696d023ef tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:34.634360 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-d4c128ce-3fe1-489d-a791-35d696d023ef tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:34.642112 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-d4c128ce-3fe1-489d-a791-35d696d023ef tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12" status: 200 len: 1681 microversion: 2.1 time: 0.153838 Jul 07 10:34:34.642677 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 432/843] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:34 2022] GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:34:35.660502 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a8ed5e95-5b8e-41d3-afb2-6d6e1c1dadc9 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:35.661216 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a8ed5e95-5b8e-41d3-afb2-6d6e1c1dadc9 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:35.668223 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a8ed5e95-5b8e-41d3-afb2-6d6e1c1dadc9 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:35.668681 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a8ed5e95-5b8e-41d3-afb2-6d6e1c1dadc9 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:35.669449 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a8ed5e95-5b8e-41d3-afb2-6d6e1c1dadc9 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:35.669891 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a8ed5e95-5b8e-41d3-afb2-6d6e1c1dadc9 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:35.800686 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a8ed5e95-5b8e-41d3-afb2-6d6e1c1dadc9 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:35.808643 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a8ed5e95-5b8e-41d3-afb2-6d6e1c1dadc9 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12" status: 200 len: 1681 microversion: 2.1 time: 0.152397 Jul 07 10:34:35.809207 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 412/844] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:35 2022] GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:34:36.825811 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a47f2d2b-b78f-41bc-b783-493d5359640f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:36.826453 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-a47f2d2b-b78f-41bc-b783-493d5359640f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:36.833117 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a47f2d2b-b78f-41bc-b783-493d5359640f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:36.833564 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a47f2d2b-b78f-41bc-b783-493d5359640f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:36.834331 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a47f2d2b-b78f-41bc-b783-493d5359640f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:36.834763 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a47f2d2b-b78f-41bc-b783-493d5359640f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:36.962425 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-a47f2d2b-b78f-41bc-b783-493d5359640f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:36.971431 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-a47f2d2b-b78f-41bc-b783-493d5359640f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12" status: 200 len: 1681 microversion: 2.1 time: 0.149427 Jul 07 10:34:36.983190 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 433/845] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:36 2022] GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:34:37.243099 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-b6cf2b22-ee48-4b53-9c78-51187c61ddb5 req-282a348e-9363-4166-bec2-b1c4d1bbdd79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55b0ddaa-4b4a-4050-a95f-dea6e7754d12", "name": "network-vif-deleted", "tag": "de9d78a0-ee28-42fd-97fe-b5ec1f75f48f"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:34:37.252560 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-b6cf2b22-ee48-4b53-9c78-51187c61ddb5 req-282a348e-9363-4166-bec2-b1c4d1bbdd79 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:37.253354 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-b6cf2b22-ee48-4b53-9c78-51187c61ddb5 req-282a348e-9363-4166-bec2-b1c4d1bbdd79 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:37.265651 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-b6cf2b22-ee48-4b53-9c78-51187c61ddb5 req-282a348e-9363-4166-bec2-b1c4d1bbdd79 service nova] Creating event network-vif-deleted:de9d78a0-ee28-42fd-97fe-b5ec1f75f48f for instance 55b0ddaa-4b4a-4050-a95f-dea6e7754d12 on hv-cinder-82282 Jul 07 10:34:37.270787 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-b6cf2b22-ee48-4b53-9c78-51187c61ddb5 req-282a348e-9363-4166-bec2-b1c4d1bbdd79 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032206 Jul 07 10:34:37.271369 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 413/846] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:34:37.990110 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-896708f2-7c02-45c8-97a0-004104aeef10 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:37.990718 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-896708f2-7c02-45c8-97a0-004104aeef10 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:37.998424 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-896708f2-7c02-45c8-97a0-004104aeef10 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:37.998872 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-896708f2-7c02-45c8-97a0-004104aeef10 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:37.999639 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-896708f2-7c02-45c8-97a0-004104aeef10 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:38.000263 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-896708f2-7c02-45c8-97a0-004104aeef10 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:38.015051 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.wsgi [None req-896708f2-7c02-45c8-97a0-004104aeef10 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] HTTP exception thrown: Instance 55b0ddaa-4b4a-4050-a95f-dea6e7754d12 could not be found. Jul 07 10:34:38.016757 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-896708f2-7c02-45c8-97a0-004104aeef10 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Request method failure captured: Jul 07 10:34:38.016757 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12 HTTP/1.1 Jul 07 10:34:38.016757 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:34:38.016757 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:34:38.016757 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:34:38.016757 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 0 Jul 07 10:34:38.016757 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:34:38.016757 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:34:38.016757 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:34:38.016757 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:34:38.016757 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrY8OvCBMJnjRdOGiniYdWVQXRU5j_oL_-3IW8B050mI9iTiMiAqckVcFrYUNMDNBzu5A7KjWAw4CfsePxF_lhVKdStuWP73EE48s908WgfQ_p-BUvui7Lff6JDUFqsZcmbVchhpCEcFgE514wUYqWgw2aG015Cpl2jakkhdOE3Gcxc Jul 07 10:34:38.016757 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:34:38.016757 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:34:38.016757 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:34:38.016757 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:34:38.016757 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:34:38.016757 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:34:38.016757 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: 1568d5b1c4bb471f9de53f4d5cf7cc82 Jul 07 10:34:38.016757 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:34:38.016757 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:34:38.016757 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:34:38.018365 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:34:38.018365 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:34:38.018365 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: 1568d5b1c4bb471f9de53f4d5cf7cc82 Jul 07 10:34:38.018365 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:34:38.018365 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-AttachVolumeNegativeTest-1710795981-project Jul 07 10:34:38.018365 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:34:38.018365 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:34:38.018365 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: 1222d8bb50554d64ac674f109b6ad077 Jul 07 10:34:38.018365 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-AttachVolumeNegativeTest-1710795981-project Jul 07 10:34:38.018365 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: > Jul 07 10:34:38.018365 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Instance 55b0ddaa-4b4a-4050-a95f-dea6e7754d12 could not be found. Jul 07 10:34:38.018365 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'id': '55b0ddaa-4b4a-4050-a95f-dea6e7754d12'} Jul 07 10:34:38.020641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:34:38.020641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:34:38.020641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:34:38.020641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:34:38.020641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:34:38.020641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:34:38.020641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:34:38.020641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:34:38.020641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:34:38.020641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:34:38.020641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55b0ddaa-4b4a-4050-a95f-dea6e7754d12 could not be found. Jul 07 10:34:38.020641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:34:38.020641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:34:38.020641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:34:38.020641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:34:38.020641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:34:38.020641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:34:38.020641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:34:38.020641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:34:38.020641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:34:38.022125 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:34:38.022125 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:34:38.022125 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:34:38.022125 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:34:38.022125 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:34:38.022125 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:34:38.022125 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:34:38.022125 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55b0ddaa-4b4a-4050-a95f-dea6e7754d12 could not be found. Jul 07 10:34:38.022125 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:34:38.022125 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:34:38.022125 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:34:38.022125 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:34:38.022125 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:34:38.022125 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:34:38.022125 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:34:38.022125 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:34:38.022125 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55b0ddaa-4b4a-4050-a95f-dea6e7754d12 could not be found. Jul 07 10:34:38.022125 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:34:38.023460 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-896708f2-7c02-45c8-97a0-004104aeef10 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Returning 404 to user: Instance 55b0ddaa-4b4a-4050-a95f-dea6e7754d12 could not be found. {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:34:38.023460 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-896708f2-7c02-45c8-97a0-004104aeef10 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12" status: 404 len: 111 microversion: 2.1 time: 0.032487 Jul 07 10:34:38.023460 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 434/847] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:37 2022] GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:34:38.027832 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9cabdb5f-8944-4b89-a22d-8f6c16303d7e tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '.version_select at 0x7f9e9e2afca0>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:38.048418 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9cabdb5f-8944-4b89-a22d-8f6c16303d7e tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1258290886" status: 202 len: 0 microversion: 2.1 time: 0.024276 Jul 07 10:34:38.049036 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 414/848] 10.222.0.16 () {58 vars in 1220 bytes} [Thu Jul 7 10:34:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1258290886 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 10:34:38.347609 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a4f45ccd-d703-400f-adc8-8587efdf444a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1938812387", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-800154750", "security_groups": [{"name": "tempest-secgroup-smoke-51530022"}], "block_device_mapping_v2": [{"uuid": "f4904bb4-bb40-48ab-a970-a1efa3f2fb07", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "06199cd4-69ed-4b3c-bfad-2ede6bfd3a79"}]}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:34:38.720867 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.network.neutron [None req-a4f45ccd-d703-400f-adc8-8587efdf444a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] validate_networks() for [('06199cd4-69ed-4b3c-bfad-2ede6bfd3a79', None, None, None, None, None)] {{(pid=117646) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 10:34:39.139649 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e8ec85ef-e365-43dc-a0cb-dfb2d9bfb116 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Action: 'create', calling method: .version_select at 0x7f9e9e2bc790>, body: {"keypair": {"name": "tempest-keypair-1347189530", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHENnuHc4YlbsOoMC5UlODYYg1ifT+TLI0wcZBQea+Pfe8wHpLDX74NId78Fccau1lhTFlaaNoYZUdyagSbPD8zvaNDw0MG+SXGWrkbvjKtceSLXkq5WlROapq2BlpyNlg=="}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:34:39.154304 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-e8ec85ef-e365-43dc-a0cb-dfb2d9bfb116 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Getting quotas for project 1568d5b1c4bb471f9de53f4d5cf7cc82. Resources: {'key_pairs'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:34:39.158026 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-e8ec85ef-e365-43dc-a0cb-dfb2d9bfb116 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Getting quotas for user 1222d8bb50554d64ac674f109b6ad077 and project 1568d5b1c4bb471f9de53f4d5cf7cc82. Resources: {'key_pairs'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:34:39.179766 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e8ec85ef-e365-43dc-a0cb-dfb2d9bfb116 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044493 Jul 07 10:34:39.180407 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 415/849] 10.222.0.16 () {60 vars in 1158 bytes} [Thu Jul 7 10:34:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 10:34:39.240138 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-a4f45ccd-d703-400f-adc8-8587efdf444a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Flavor limits 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 10:34:39.240654 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-a4f45ccd-d703-400f-adc8-8587efdf444a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Image limits 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 10:34:39.241197 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-a4f45ccd-d703-400f-adc8-8587efdf444a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Flavor pref 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 10:34:39.241654 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-a4f45ccd-d703-400f-adc8-8587efdf444a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Image pref 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 10:34:39.242111 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-a4f45ccd-d703-400f-adc8-8587efdf444a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 10:34:39.250968 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a4f45ccd-d703-400f-adc8-8587efdf444a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:39.251414 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a4f45ccd-d703-400f-adc8-8587efdf444a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:39.252251 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a4f45ccd-d703-400f-adc8-8587efdf444a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:39.252681 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a4f45ccd-d703-400f-adc8-8587efdf444a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:39.271066 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-a4f45ccd-d703-400f-adc8-8587efdf444a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Getting quotas for project 12a91d56e163442dacf4c5ce7b28a132. Resources: {'cores', 'ram', 'instances'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:34:39.275993 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-a4f45ccd-d703-400f-adc8-8587efdf444a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Getting quotas for user 059a87a80fc547db8aeb3bb03003cd2c and project 12a91d56e163442dacf4c5ce7b28a132. Resources: {'cores', 'ram', 'instances'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:34:39.338334 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-a4f45ccd-d703-400f-adc8-8587efdf444a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Going to run 1 instances... {{(pid=117646) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 10:34:39.340838 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-a4f45ccd-d703-400f-adc8-8587efdf444a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 508054db-8968-4f14-ad81-973a970d7039] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f4904bb4-bb40-48ab-a970-a1efa3f2fb07',volume_size=None,volume_type=None)] {{(pid=117646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 10:34:39.476129 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-a4f45ccd-d703-400f-adc8-8587efdf444a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.132210 Jul 07 10:34:39.477788 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 435/850] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jul 7 10:34:38 2022] POST /compute/v2.1/servers => generated 404 bytes in 1134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 10:34:39.488495 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c0f8a36e-7ba8-4788-8897-46cef0bc82cc tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:39.489229 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c0f8a36e-7ba8-4788-8897-46cef0bc82cc tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 508054db-8968-4f14-ad81-973a970d7039] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:39.550030 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c0f8a36e-7ba8-4788-8897-46cef0bc82cc tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:39.558376 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c0f8a36e-7ba8-4788-8897-46cef0bc82cc tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039" status: 200 len: 1094 microversion: 2.1 time: 0.074303 Jul 07 10:34:39.559059 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 416/851] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:39 2022] GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:34:40.533024 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-bb53c424-3803-4468-a639-80ec051c4056 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1363652910", "imageRef": "1c96509d-f65f-42b0-94b3-6fc590a93508", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ddda3840-6dd5-4197-ae4c-bd6a56e53d5c"}], "security_groups": [{"name": "tempest-securitygroup--1248833803"}], "key_name": "tempest-keypair-1347189530", "user_data": "}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:34:40.576434 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ebf233db-7418-4b5e-91c4-402f6e629bf8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:40.577667 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ebf233db-7418-4b5e-91c4-402f6e629bf8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 508054db-8968-4f14-ad81-973a970d7039] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:40.584665 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ebf233db-7418-4b5e-91c4-402f6e629bf8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:40.586558 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ebf233db-7418-4b5e-91c4-402f6e629bf8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:40.587535 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ebf233db-7418-4b5e-91c4-402f6e629bf8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:40.588184 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ebf233db-7418-4b5e-91c4-402f6e629bf8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:40.655849 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.network.neutron [None req-bb53c424-3803-4468-a639-80ec051c4056 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] validate_networks() for [('ddda3840-6dd5-4197-ae4c-bd6a56e53d5c', None, None, None, None, None)] {{(pid=117646) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 10:34:40.679299 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ebf233db-7418-4b5e-91c4-402f6e629bf8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:40.687675 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ebf233db-7418-4b5e-91c4-402f6e629bf8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039" status: 200 len: 1210 microversion: 2.1 time: 0.115131 Jul 07 10:34:40.688885 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 417/852] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:40 2022] GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039 => generated 1210 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:34:41.044204 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-bb53c424-3803-4468-a639-80ec051c4056 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Flavor limits 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 10:34:41.044637 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-bb53c424-3803-4468-a639-80ec051c4056 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Image limits 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 10:34:41.045351 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-bb53c424-3803-4468-a639-80ec051c4056 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Flavor pref 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 10:34:41.045977 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-bb53c424-3803-4468-a639-80ec051c4056 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Image pref 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 10:34:41.046606 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-bb53c424-3803-4468-a639-80ec051c4056 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 10:34:41.057078 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bb53c424-3803-4468-a639-80ec051c4056 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:41.057538 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bb53c424-3803-4468-a639-80ec051c4056 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:41.058388 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bb53c424-3803-4468-a639-80ec051c4056 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:41.058824 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bb53c424-3803-4468-a639-80ec051c4056 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:41.077283 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-bb53c424-3803-4468-a639-80ec051c4056 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Getting quotas for project 1568d5b1c4bb471f9de53f4d5cf7cc82. Resources: {'cores', 'ram', 'instances'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:34:41.081415 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-bb53c424-3803-4468-a639-80ec051c4056 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Getting quotas for user 1222d8bb50554d64ac674f109b6ad077 and project 1568d5b1c4bb471f9de53f4d5cf7cc82. Resources: {'cores', 'ram', 'instances'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:34:41.094226 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-bb53c424-3803-4468-a639-80ec051c4056 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Going to run 1 instances... {{(pid=117646) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 10:34:41.096560 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-bb53c424-3803-4468-a639-80ec051c4056 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: b25327c6-c3ad-44eb-90ef-3ab8e86c426e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c96509d-f65f-42b0-94b3-6fc590a93508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 10:34:41.149468 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-bb53c424-3803-4468-a639-80ec051c4056 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.620725 Jul 07 10:34:41.150199 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 436/853] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jul 7 10:34:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 10:34:41.160205 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-f5fb6fbe-a0ea-4022-94bb-b4628b073dc3 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:41.160838 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-f5fb6fbe-a0ea-4022-94bb-b4628b073dc3 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: b25327c6-c3ad-44eb-90ef-3ab8e86c426e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:41.246587 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f5fb6fbe-a0ea-4022-94bb-b4628b073dc3 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:41.254735 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-f5fb6fbe-a0ea-4022-94bb-b4628b073dc3 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e" status: 200 len: 1242 microversion: 2.1 time: 0.098255 Jul 07 10:34:41.255693 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 418/854] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:41 2022] GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e => generated 1242 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:34:41.705992 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-631c3b80-6d31-4690-84be-c1f0a2824b74 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:41.707409 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-631c3b80-6d31-4690-84be-c1f0a2824b74 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 508054db-8968-4f14-ad81-973a970d7039] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:41.715619 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-631c3b80-6d31-4690-84be-c1f0a2824b74 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:41.716787 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-631c3b80-6d31-4690-84be-c1f0a2824b74 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:41.717599 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-631c3b80-6d31-4690-84be-c1f0a2824b74 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:41.718230 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-631c3b80-6d31-4690-84be-c1f0a2824b74 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:41.886216 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-631c3b80-6d31-4690-84be-c1f0a2824b74 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:41.894790 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-631c3b80-6d31-4690-84be-c1f0a2824b74 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039" status: 200 len: 1264 microversion: 2.1 time: 0.192655 Jul 07 10:34:41.895378 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 437/855] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:41 2022] GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039 => generated 1264 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:34:41.989990 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-7a89fa41-17f3-40e1-98e4-97583c892112 req-62000416-58d4-4340-8480-ad52a2dbec9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "508054db-8968-4f14-ad81-973a970d7039", "tag": "4c958c7f-c732-46dd-ab0f-9c7fb9c56d25"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:34:42.011132 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-7a89fa41-17f3-40e1-98e4-97583c892112 req-62000416-58d4-4340-8480-ad52a2dbec9d service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:42.014043 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-7a89fa41-17f3-40e1-98e4-97583c892112 req-62000416-58d4-4340-8480-ad52a2dbec9d service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:42.026287 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-7a89fa41-17f3-40e1-98e4-97583c892112 req-62000416-58d4-4340-8480-ad52a2dbec9d service nova] Creating event network-changed:4c958c7f-c732-46dd-ab0f-9c7fb9c56d25 for instance 508054db-8968-4f14-ad81-973a970d7039 on hv-cinder-82282 Jul 07 10:34:42.031169 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-7a89fa41-17f3-40e1-98e4-97583c892112 req-62000416-58d4-4340-8480-ad52a2dbec9d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045142 Jul 07 10:34:42.031960 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 419/856] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:34:42.271762 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-218ab981-5949-4994-a084-af0501919424 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:42.272441 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-218ab981-5949-4994-a084-af0501919424 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: b25327c6-c3ad-44eb-90ef-3ab8e86c426e] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:42.279827 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-218ab981-5949-4994-a084-af0501919424 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:42.280311 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-218ab981-5949-4994-a084-af0501919424 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:42.281081 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-218ab981-5949-4994-a084-af0501919424 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:42.281696 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-218ab981-5949-4994-a084-af0501919424 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:42.353171 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-218ab981-5949-4994-a084-af0501919424 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:42.361374 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-218ab981-5949-4994-a084-af0501919424 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e" status: 200 len: 1302 microversion: 2.1 time: 0.093432 Jul 07 10:34:42.371798 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 438/857] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:42 2022] GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e => generated 1302 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:34:42.913039 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-f0687e98-6a2b-4955-a81d-f7b306fe3ce6 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:42.913738 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-f0687e98-6a2b-4955-a81d-f7b306fe3ce6 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 508054db-8968-4f14-ad81-973a970d7039] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:42.919928 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f0687e98-6a2b-4955-a81d-f7b306fe3ce6 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:42.920384 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f0687e98-6a2b-4955-a81d-f7b306fe3ce6 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:42.921152 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f0687e98-6a2b-4955-a81d-f7b306fe3ce6 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:42.921593 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f0687e98-6a2b-4955-a81d-f7b306fe3ce6 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:43.237598 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f0687e98-6a2b-4955-a81d-f7b306fe3ce6 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:43.245097 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-f0687e98-6a2b-4955-a81d-f7b306fe3ce6 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039" status: 200 len: 1264 microversion: 2.1 time: 0.336378 Jul 07 10:34:43.245670 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 420/858] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:42 2022] GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039 => generated 1264 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:34:43.378623 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-7be73eb6-e0aa-4517-a997-6b29c2a19adb tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:43.379239 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-7be73eb6-e0aa-4517-a997-6b29c2a19adb tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: b25327c6-c3ad-44eb-90ef-3ab8e86c426e] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:43.386691 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7be73eb6-e0aa-4517-a997-6b29c2a19adb tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:43.387236 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7be73eb6-e0aa-4517-a997-6b29c2a19adb tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:43.388125 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7be73eb6-e0aa-4517-a997-6b29c2a19adb tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:43.388637 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7be73eb6-e0aa-4517-a997-6b29c2a19adb tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:43.603536 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-7be73eb6-e0aa-4517-a997-6b29c2a19adb tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:43.611085 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-7be73eb6-e0aa-4517-a997-6b29c2a19adb tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e" status: 200 len: 1300 microversion: 2.1 time: 0.236408 Jul 07 10:34:43.611683 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 439/859] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:43 2022] GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e => generated 1300 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:34:44.263330 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c1f84c5c-2413-42bf-95eb-3969a942171d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:44.264025 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c1f84c5c-2413-42bf-95eb-3969a942171d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 508054db-8968-4f14-ad81-973a970d7039] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:44.270683 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c1f84c5c-2413-42bf-95eb-3969a942171d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:44.271011 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c1f84c5c-2413-42bf-95eb-3969a942171d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:44.271846 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c1f84c5c-2413-42bf-95eb-3969a942171d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:44.272296 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c1f84c5c-2413-42bf-95eb-3969a942171d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:44.465147 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c1f84c5c-2413-42bf-95eb-3969a942171d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:44.472778 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c1f84c5c-2413-42bf-95eb-3969a942171d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039" status: 200 len: 1264 microversion: 2.1 time: 0.213554 Jul 07 10:34:44.473347 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 421/860] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:44 2022] GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039 => generated 1264 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:34:44.529159 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-312a246d-4d05-4c66-93b9-7c4ebe1a457b req-c2abc9d8-14e3-4d26-95a2-8e423327ea95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b25327c6-c3ad-44eb-90ef-3ab8e86c426e", "tag": "ae026b25-1a96-48c6-878b-9c0ba70416c5"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:34:44.550343 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-312a246d-4d05-4c66-93b9-7c4ebe1a457b req-c2abc9d8-14e3-4d26-95a2-8e423327ea95 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:44.550696 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-312a246d-4d05-4c66-93b9-7c4ebe1a457b req-c2abc9d8-14e3-4d26-95a2-8e423327ea95 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:44.567500 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-312a246d-4d05-4c66-93b9-7c4ebe1a457b req-c2abc9d8-14e3-4d26-95a2-8e423327ea95 service nova] Creating event network-changed:ae026b25-1a96-48c6-878b-9c0ba70416c5 for instance b25327c6-c3ad-44eb-90ef-3ab8e86c426e on hv-cinder-82282 Jul 07 10:34:44.573843 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-312a246d-4d05-4c66-93b9-7c4ebe1a457b req-c2abc9d8-14e3-4d26-95a2-8e423327ea95 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049574 Jul 07 10:34:44.574516 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 440/861] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:34:44.629947 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-262bdb3b-55a3-48ce-9060-cee2fd6cbaaf tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:44.630642 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-262bdb3b-55a3-48ce-9060-cee2fd6cbaaf tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: b25327c6-c3ad-44eb-90ef-3ab8e86c426e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:44.636942 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-262bdb3b-55a3-48ce-9060-cee2fd6cbaaf tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:44.637664 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-262bdb3b-55a3-48ce-9060-cee2fd6cbaaf tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:44.638498 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-262bdb3b-55a3-48ce-9060-cee2fd6cbaaf tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:44.638975 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-262bdb3b-55a3-48ce-9060-cee2fd6cbaaf tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:44.842536 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-262bdb3b-55a3-48ce-9060-cee2fd6cbaaf tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:44.850306 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-262bdb3b-55a3-48ce-9060-cee2fd6cbaaf tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e" status: 200 len: 1368 microversion: 2.1 time: 0.224485 Jul 07 10:34:44.850916 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 422/862] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:44 2022] GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:34:45.489931 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-4389f076-1638-4ee4-9d53-21c25682e171 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:45.490654 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-4389f076-1638-4ee4-9d53-21c25682e171 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 508054db-8968-4f14-ad81-973a970d7039] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:45.496815 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4389f076-1638-4ee4-9d53-21c25682e171 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:45.497267 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4389f076-1638-4ee4-9d53-21c25682e171 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:45.498024 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4389f076-1638-4ee4-9d53-21c25682e171 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:45.498460 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4389f076-1638-4ee4-9d53-21c25682e171 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:45.628805 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-4389f076-1638-4ee4-9d53-21c25682e171 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:45.636590 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-4389f076-1638-4ee4-9d53-21c25682e171 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039" status: 200 len: 1264 microversion: 2.1 time: 0.150888 Jul 07 10:34:45.637129 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 441/863] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:45 2022] GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:34:45.867895 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-405d6994-3f8d-4a9c-a88e-e38e5cb0a071 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:45.868505 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-405d6994-3f8d-4a9c-a88e-e38e5cb0a071 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: b25327c6-c3ad-44eb-90ef-3ab8e86c426e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:45.874866 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-405d6994-3f8d-4a9c-a88e-e38e5cb0a071 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:45.875311 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-405d6994-3f8d-4a9c-a88e-e38e5cb0a071 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:45.876085 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-405d6994-3f8d-4a9c-a88e-e38e5cb0a071 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:45.876518 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-405d6994-3f8d-4a9c-a88e-e38e5cb0a071 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:46.082729 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-405d6994-3f8d-4a9c-a88e-e38e5cb0a071 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:46.090458 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-405d6994-3f8d-4a9c-a88e-e38e5cb0a071 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e" status: 200 len: 1368 microversion: 2.1 time: 0.226890 Jul 07 10:34:46.091093 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 423/864] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:45 2022] GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e => generated 1368 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:34:46.653791 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-fd43a920-c636-4191-9297-ec1a6ead5c4b tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:46.654399 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-fd43a920-c636-4191-9297-ec1a6ead5c4b tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 508054db-8968-4f14-ad81-973a970d7039] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:46.660893 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fd43a920-c636-4191-9297-ec1a6ead5c4b tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:46.661351 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fd43a920-c636-4191-9297-ec1a6ead5c4b tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:46.662111 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fd43a920-c636-4191-9297-ec1a6ead5c4b tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:46.662556 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fd43a920-c636-4191-9297-ec1a6ead5c4b tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:46.791188 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-fd43a920-c636-4191-9297-ec1a6ead5c4b tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:46.798604 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-fd43a920-c636-4191-9297-ec1a6ead5c4b tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039" status: 200 len: 1264 microversion: 2.1 time: 0.148661 Jul 07 10:34:46.799161 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 442/865] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:46 2022] GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:34:47.106817 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-10ae6633-b17a-4c6e-9ce1-365ece4512c0 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:47.107456 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-10ae6633-b17a-4c6e-9ce1-365ece4512c0 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: b25327c6-c3ad-44eb-90ef-3ab8e86c426e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:47.114089 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-10ae6633-b17a-4c6e-9ce1-365ece4512c0 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:47.114531 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-10ae6633-b17a-4c6e-9ce1-365ece4512c0 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:47.115277 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-10ae6633-b17a-4c6e-9ce1-365ece4512c0 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:47.115706 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-10ae6633-b17a-4c6e-9ce1-365ece4512c0 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:47.245328 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-10ae6633-b17a-4c6e-9ce1-365ece4512c0 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:47.252885 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-10ae6633-b17a-4c6e-9ce1-365ece4512c0 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e" status: 200 len: 1368 microversion: 2.1 time: 0.150002 Jul 07 10:34:47.253489 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 424/866] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:47 2022] GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:34:47.814449 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-7257e9d8-e01a-4819-84c5-25120fb1ecf4 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:47.815163 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-7257e9d8-e01a-4819-84c5-25120fb1ecf4 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 508054db-8968-4f14-ad81-973a970d7039] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:47.821703 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7257e9d8-e01a-4819-84c5-25120fb1ecf4 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:47.822381 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7257e9d8-e01a-4819-84c5-25120fb1ecf4 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:47.823148 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7257e9d8-e01a-4819-84c5-25120fb1ecf4 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:47.823588 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7257e9d8-e01a-4819-84c5-25120fb1ecf4 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:47.959403 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-7257e9d8-e01a-4819-84c5-25120fb1ecf4 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:47.968805 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-7257e9d8-e01a-4819-84c5-25120fb1ecf4 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039" status: 200 len: 1264 microversion: 2.1 time: 0.158236 Jul 07 10:34:47.970056 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 443/867] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:47 2022] GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:34:48.270028 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-68dc8bda-2c10-4d41-b712-f3b35ce2b774 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:48.270647 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-68dc8bda-2c10-4d41-b712-f3b35ce2b774 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: b25327c6-c3ad-44eb-90ef-3ab8e86c426e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:48.277137 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-68dc8bda-2c10-4d41-b712-f3b35ce2b774 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:48.277592 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-68dc8bda-2c10-4d41-b712-f3b35ce2b774 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:48.278381 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-68dc8bda-2c10-4d41-b712-f3b35ce2b774 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:48.278811 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-68dc8bda-2c10-4d41-b712-f3b35ce2b774 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:48.405012 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-68dc8bda-2c10-4d41-b712-f3b35ce2b774 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:48.412363 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-68dc8bda-2c10-4d41-b712-f3b35ce2b774 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e" status: 200 len: 1368 microversion: 2.1 time: 0.146276 Jul 07 10:34:48.412924 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 425/868] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:48 2022] GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:34:48.985202 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-34a864de-7e40-4cf1-a5a0-87d66c2ed429 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:48.985816 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-34a864de-7e40-4cf1-a5a0-87d66c2ed429 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 508054db-8968-4f14-ad81-973a970d7039] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:48.992376 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-34a864de-7e40-4cf1-a5a0-87d66c2ed429 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:48.992816 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-34a864de-7e40-4cf1-a5a0-87d66c2ed429 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:48.993579 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-34a864de-7e40-4cf1-a5a0-87d66c2ed429 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:48.994020 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-34a864de-7e40-4cf1-a5a0-87d66c2ed429 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:49.119968 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-34a864de-7e40-4cf1-a5a0-87d66c2ed429 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:49.127271 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-34a864de-7e40-4cf1-a5a0-87d66c2ed429 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039" status: 200 len: 1264 microversion: 2.1 time: 0.145964 Jul 07 10:34:49.127853 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 444/869] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:48 2022] GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039 => generated 1264 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:34:49.430123 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-cb9602dd-0701-468c-b1e4-779ef71cbae5 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:49.430729 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-cb9602dd-0701-468c-b1e4-779ef71cbae5 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: b25327c6-c3ad-44eb-90ef-3ab8e86c426e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:49.437223 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cb9602dd-0701-468c-b1e4-779ef71cbae5 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:49.437673 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cb9602dd-0701-468c-b1e4-779ef71cbae5 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:49.438431 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cb9602dd-0701-468c-b1e4-779ef71cbae5 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:49.438867 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cb9602dd-0701-468c-b1e4-779ef71cbae5 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:49.570680 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-cb9602dd-0701-468c-b1e4-779ef71cbae5 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:49.578044 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-cb9602dd-0701-468c-b1e4-779ef71cbae5 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e" status: 200 len: 1368 microversion: 2.1 time: 0.152294 Jul 07 10:34:49.578607 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 426/870] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:49 2022] GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:34:49.900141 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-4633d089-0318-47a3-a2b3-96059676d7d9 req-d36b420f-37e2-4711-a416-80b4aca29f08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b25327c6-c3ad-44eb-90ef-3ab8e86c426e", "name": "network-vif-plugged", "status": "completed", "tag": "ae026b25-1a96-48c6-878b-9c0ba70416c5"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:34:49.908915 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-4633d089-0318-47a3-a2b3-96059676d7d9 req-d36b420f-37e2-4711-a416-80b4aca29f08 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:49.909372 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-4633d089-0318-47a3-a2b3-96059676d7d9 req-d36b420f-37e2-4711-a416-80b4aca29f08 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:49.921997 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-4633d089-0318-47a3-a2b3-96059676d7d9 req-d36b420f-37e2-4711-a416-80b4aca29f08 service nova] Creating event network-vif-plugged:ae026b25-1a96-48c6-878b-9c0ba70416c5 for instance b25327c6-c3ad-44eb-90ef-3ab8e86c426e on hv-cinder-82282 Jul 07 10:34:49.926624 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-4633d089-0318-47a3-a2b3-96059676d7d9 req-d36b420f-37e2-4711-a416-80b4aca29f08 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030719 Jul 07 10:34:49.927191 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 445/871] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:34:50.144516 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e099fe8f-ba0d-43e2-9403-ce735b081003 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:50.145124 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e099fe8f-ba0d-43e2-9403-ce735b081003 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 508054db-8968-4f14-ad81-973a970d7039] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:50.150989 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e099fe8f-ba0d-43e2-9403-ce735b081003 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:50.151436 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e099fe8f-ba0d-43e2-9403-ce735b081003 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:50.152216 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e099fe8f-ba0d-43e2-9403-ce735b081003 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:50.152649 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e099fe8f-ba0d-43e2-9403-ce735b081003 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:50.281724 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e099fe8f-ba0d-43e2-9403-ce735b081003 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:50.289687 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e099fe8f-ba0d-43e2-9403-ce735b081003 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039" status: 200 len: 1264 microversion: 2.1 time: 0.149048 Jul 07 10:34:50.290245 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 427/872] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:50 2022] GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:34:50.595229 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-6970f456-b1d4-473a-a412-964489555a13 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:50.595945 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-6970f456-b1d4-473a-a412-964489555a13 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: b25327c6-c3ad-44eb-90ef-3ab8e86c426e] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:50.602102 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6970f456-b1d4-473a-a412-964489555a13 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:50.602547 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6970f456-b1d4-473a-a412-964489555a13 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:50.603295 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6970f456-b1d4-473a-a412-964489555a13 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:50.603766 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6970f456-b1d4-473a-a412-964489555a13 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:50.730434 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-6970f456-b1d4-473a-a412-964489555a13 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:50.737680 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-6970f456-b1d4-473a-a412-964489555a13 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e" status: 200 len: 1368 microversion: 2.1 time: 0.147026 Jul 07 10:34:50.738235 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 446/873] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:50 2022] GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:34:51.306340 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-85cb3909-9c10-443f-a183-b7756d24d5cb tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:51.306956 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-85cb3909-9c10-443f-a183-b7756d24d5cb tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 508054db-8968-4f14-ad81-973a970d7039] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:51.309408 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=8 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:34:51.314834 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-85cb3909-9c10-443f-a183-b7756d24d5cb tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:51.315312 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-85cb3909-9c10-443f-a183-b7756d24d5cb tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:51.316353 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-85cb3909-9c10-443f-a183-b7756d24d5cb tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:51.316789 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-85cb3909-9c10-443f-a183-b7756d24d5cb tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:51.449591 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-85cb3909-9c10-443f-a183-b7756d24d5cb tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:51.457081 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-85cb3909-9c10-443f-a183-b7756d24d5cb tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039" status: 200 len: 1264 microversion: 2.1 time: 0.154656 Jul 07 10:34:51.457646 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 428/874] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:51 2022] GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:34:51.754366 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-9cadc22c-b53a-4d6a-ad80-c2ccfd2d3026 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:51.754985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-9cadc22c-b53a-4d6a-ad80-c2ccfd2d3026 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: b25327c6-c3ad-44eb-90ef-3ab8e86c426e] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:51.757036 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell0:SELECT=4 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:34:51.757767 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell0:SELECT=12 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:34:51.764143 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9cadc22c-b53a-4d6a-ad80-c2ccfd2d3026 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:51.764597 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9cadc22c-b53a-4d6a-ad80-c2ccfd2d3026 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:51.765371 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9cadc22c-b53a-4d6a-ad80-c2ccfd2d3026 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:51.765815 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9cadc22c-b53a-4d6a-ad80-c2ccfd2d3026 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:51.896960 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-9cadc22c-b53a-4d6a-ad80-c2ccfd2d3026 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:51.904701 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-9cadc22c-b53a-4d6a-ad80-c2ccfd2d3026 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e" status: 200 len: 1558 microversion: 2.1 time: 0.154151 Jul 07 10:34:51.905343 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 447/875] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:51 2022] GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:34:51.920755 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-efa37aae-e8d9-425b-b052-58f0cd38f583 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:51.921255 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-efa37aae-e8d9-425b-b052-58f0cd38f583 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: b25327c6-c3ad-44eb-90ef-3ab8e86c426e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:51.927185 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-efa37aae-e8d9-425b-b052-58f0cd38f583 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:51.927641 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-efa37aae-e8d9-425b-b052-58f0cd38f583 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:51.928448 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-efa37aae-e8d9-425b-b052-58f0cd38f583 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:51.929409 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-efa37aae-e8d9-425b-b052-58f0cd38f583 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:51.946977 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:34:52.009437 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-efa37aae-e8d9-425b-b052-58f0cd38f583 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092545 Jul 07 10:34:52.010075 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 429/876] 10.222.0.16 () {58 vars in 1274 bytes} [Thu Jul 7 10:34:51 2022] GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 10:34:52.473942 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-fcfb5b3a-3574-478c-bf29-0c885558f9e6 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:52.474590 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-fcfb5b3a-3574-478c-bf29-0c885558f9e6 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 508054db-8968-4f14-ad81-973a970d7039] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:52.481300 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fcfb5b3a-3574-478c-bf29-0c885558f9e6 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:52.481787 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fcfb5b3a-3574-478c-bf29-0c885558f9e6 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:52.482653 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fcfb5b3a-3574-478c-bf29-0c885558f9e6 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:52.483104 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fcfb5b3a-3574-478c-bf29-0c885558f9e6 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:52.612118 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-fcfb5b3a-3574-478c-bf29-0c885558f9e6 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:52.620144 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-fcfb5b3a-3574-478c-bf29-0c885558f9e6 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039" status: 200 len: 1264 microversion: 2.1 time: 0.150122 Jul 07 10:34:52.620713 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 448/877] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:52 2022] GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:34:52.926740 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-cc7ba64a-cbb8-4e63-a117-5969ac66ee85 req-086c7e03-e11c-4fbc-94b8-dc3c23a9be5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b25327c6-c3ad-44eb-90ef-3ab8e86c426e", "tag": "ae026b25-1a96-48c6-878b-9c0ba70416c5"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:34:52.934687 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-cc7ba64a-cbb8-4e63-a117-5969ac66ee85 req-086c7e03-e11c-4fbc-94b8-dc3c23a9be5e service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:52.935127 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-cc7ba64a-cbb8-4e63-a117-5969ac66ee85 req-086c7e03-e11c-4fbc-94b8-dc3c23a9be5e service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:52.946768 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-cc7ba64a-cbb8-4e63-a117-5969ac66ee85 req-086c7e03-e11c-4fbc-94b8-dc3c23a9be5e service nova] Creating event network-changed:ae026b25-1a96-48c6-878b-9c0ba70416c5 for instance b25327c6-c3ad-44eb-90ef-3ab8e86c426e on hv-cinder-82282 Jul 07 10:34:52.951820 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-cc7ba64a-cbb8-4e63-a117-5969ac66ee85 req-086c7e03-e11c-4fbc-94b8-dc3c23a9be5e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029300 Jul 07 10:34:52.952624 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 430/878] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:34:53.637413 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a027722a-646e-48f0-820b-e3b61295aa6a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:53.637997 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-a027722a-646e-48f0-820b-e3b61295aa6a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 508054db-8968-4f14-ad81-973a970d7039] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:53.644022 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a027722a-646e-48f0-820b-e3b61295aa6a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:53.644478 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a027722a-646e-48f0-820b-e3b61295aa6a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:53.645244 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a027722a-646e-48f0-820b-e3b61295aa6a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:53.645683 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a027722a-646e-48f0-820b-e3b61295aa6a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:53.782558 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-a027722a-646e-48f0-820b-e3b61295aa6a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:53.790709 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-a027722a-646e-48f0-820b-e3b61295aa6a tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039" status: 200 len: 1264 microversion: 2.1 time: 0.157242 Jul 07 10:34:53.791288 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 449/879] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:53 2022] GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:34:53.994755 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-6c389c6d-b9ae-42ea-b52f-53176a12782b req-9a914cd5-c307-4636-ba50-2622cc5196a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "508054db-8968-4f14-ad81-973a970d7039", "name": "network-vif-plugged", "status": "completed", "tag": "4c958c7f-c732-46dd-ab0f-9c7fb9c56d25"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:34:54.003499 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-6c389c6d-b9ae-42ea-b52f-53176a12782b req-9a914cd5-c307-4636-ba50-2622cc5196a6 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:54.003979 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-6c389c6d-b9ae-42ea-b52f-53176a12782b req-9a914cd5-c307-4636-ba50-2622cc5196a6 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:54.015596 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-6c389c6d-b9ae-42ea-b52f-53176a12782b req-9a914cd5-c307-4636-ba50-2622cc5196a6 service nova] Creating event network-vif-plugged:4c958c7f-c732-46dd-ab0f-9c7fb9c56d25 for instance 508054db-8968-4f14-ad81-973a970d7039 on hv-cinder-82282 Jul 07 10:34:54.020598 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-6c389c6d-b9ae-42ea-b52f-53176a12782b req-9a914cd5-c307-4636-ba50-2622cc5196a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030316 Jul 07 10:34:54.021458 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 431/880] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:34:54.808102 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-12abb3d5-325d-4e0e-82a2-0eee56a7e705 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:54.808609 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-12abb3d5-325d-4e0e-82a2-0eee56a7e705 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 508054db-8968-4f14-ad81-973a970d7039] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:54.815121 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-12abb3d5-325d-4e0e-82a2-0eee56a7e705 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:54.815580 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-12abb3d5-325d-4e0e-82a2-0eee56a7e705 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:54.816627 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-12abb3d5-325d-4e0e-82a2-0eee56a7e705 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:54.817067 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-12abb3d5-325d-4e0e-82a2-0eee56a7e705 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:54.821495 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=100 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:34:54.947026 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-12abb3d5-325d-4e0e-82a2-0eee56a7e705 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:54.954493 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-12abb3d5-325d-4e0e-82a2-0eee56a7e705 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039" status: 200 len: 1264 microversion: 2.1 time: 0.150880 Jul 07 10:34:54.955055 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 450/881] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:54 2022] GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:34:55.972021 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-834b1668-143f-42a5-9d11-91860a4e482b tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:55.972717 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-834b1668-143f-42a5-9d11-91860a4e482b tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 508054db-8968-4f14-ad81-973a970d7039] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:55.979525 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-834b1668-143f-42a5-9d11-91860a4e482b tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:55.980038 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-834b1668-143f-42a5-9d11-91860a4e482b tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:55.980846 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-834b1668-143f-42a5-9d11-91860a4e482b tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:55.981384 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-834b1668-143f-42a5-9d11-91860a4e482b tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:56.113984 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-834b1668-143f-42a5-9d11-91860a4e482b tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:56.122067 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-834b1668-143f-42a5-9d11-91860a4e482b tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039" status: 200 len: 1452 microversion: 2.1 time: 0.155189 Jul 07 10:34:56.123241 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 432/882] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:55 2022] GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:34:56.137704 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-03b70bfd-a7bc-46da-9b5d-44c79a7103b8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:34:56.138317 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-03b70bfd-a7bc-46da-9b5d-44c79a7103b8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 508054db-8968-4f14-ad81-973a970d7039] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:34:56.144820 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-03b70bfd-a7bc-46da-9b5d-44c79a7103b8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:56.145276 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-03b70bfd-a7bc-46da-9b5d-44c79a7103b8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:56.146041 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-03b70bfd-a7bc-46da-9b5d-44c79a7103b8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:56.146488 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-03b70bfd-a7bc-46da-9b5d-44c79a7103b8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:56.272285 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-03b70bfd-a7bc-46da-9b5d-44c79a7103b8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:34:56.280100 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-03b70bfd-a7bc-46da-9b5d-44c79a7103b8 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039" status: 200 len: 1452 microversion: 2.1 time: 0.146251 Jul 07 10:34:56.280653 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 451/883] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:34:56 2022] GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039 => generated 1452 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:34:57.846201 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-a7f49f63-c862-4108-9f1f-74d561cf035a req-7ba29203-a999-4654-8db6-e7473bb87e6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "508054db-8968-4f14-ad81-973a970d7039", "tag": "4c958c7f-c732-46dd-ab0f-9c7fb9c56d25"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:34:57.855924 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-a7f49f63-c862-4108-9f1f-74d561cf035a req-7ba29203-a999-4654-8db6-e7473bb87e6c service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:34:57.856375 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-a7f49f63-c862-4108-9f1f-74d561cf035a req-7ba29203-a999-4654-8db6-e7473bb87e6c service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:34:57.867591 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-a7f49f63-c862-4108-9f1f-74d561cf035a req-7ba29203-a999-4654-8db6-e7473bb87e6c service nova] Creating event network-changed:4c958c7f-c732-46dd-ab0f-9c7fb9c56d25 for instance 508054db-8968-4f14-ad81-973a970d7039 on hv-cinder-82282 Jul 07 10:34:57.872873 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-a7f49f63-c862-4108-9f1f-74d561cf035a req-7ba29203-a999-4654-8db6-e7473bb87e6c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030278 Jul 07 10:34:57.873484 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 433/884] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:35:06.442693 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-e3f06d21-3f53-46e3-b95b-6aab32d44e0f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:06.443263 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-e3f06d21-3f53-46e3-b95b-6aab32d44e0f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:06.445666 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=6 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:35:06.446451 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=10 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:35:06.452698 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e3f06d21-3f53-46e3-b95b-6aab32d44e0f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:06.453160 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e3f06d21-3f53-46e3-b95b-6aab32d44e0f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:06.453924 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e3f06d21-3f53-46e3-b95b-6aab32d44e0f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:06.454363 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e3f06d21-3f53-46e3-b95b-6aab32d44e0f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:06.477432 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-e3f06d21-3f53-46e3-b95b-6aab32d44e0f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7/ips" status: 200 len: 150 microversion: 2.20 time: 0.038960 Jul 07 10:35:06.477990 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 452/885] 10.222.0.16 () {60 vars in 1288 bytes} [Thu Jul 7 10:35:06 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 10:35:08.271495 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:35:08.272768 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=12 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:35:08.277012 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1c955f89-e58d-4d8e-9124-eb175c660fa3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:35:08.277633 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1c955f89-e58d-4d8e-9124-eb175c660fa3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:08.284751 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1c955f89-e58d-4d8e-9124-eb175c660fa3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:08.285206 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1c955f89-e58d-4d8e-9124-eb175c660fa3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:08.285968 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1c955f89-e58d-4d8e-9124-eb175c660fa3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:08.286408 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1c955f89-e58d-4d8e-9124-eb175c660fa3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:08.310210 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.objects.instance [None req-1c955f89-e58d-4d8e-9124-eb175c660fa3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lazy-loading 'flavor' on Instance uuid 0e66414c-2b54-4dcf-822c-96e90792fac7 {{(pid=117647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 10:35:08.561067 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1c955f89-e58d-4d8e-9124-eb175c660fa3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "POST /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7/action" status: 202 len: 0 microversion: 2.20 time: 0.291012 Jul 07 10:35:08.561943 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 434/886] 10.222.0.16 () {62 vars in 1318 bytes} [Thu Jul 7 10:35:08 2022] POST /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 07 10:35:08.570500 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-5e761307-0e4d-4aa4-bdc8-a464050b81d7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:08.571115 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-5e761307-0e4d-4aa4-bdc8-a464050b81d7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:08.578624 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5e761307-0e4d-4aa4-bdc8-a464050b81d7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:08.579084 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5e761307-0e4d-4aa4-bdc8-a464050b81d7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:08.579887 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5e761307-0e4d-4aa4-bdc8-a464050b81d7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:08.580332 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5e761307-0e4d-4aa4-bdc8-a464050b81d7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:08.711339 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-5e761307-0e4d-4aa4-bdc8-a464050b81d7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:08.719146 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-5e761307-0e4d-4aa4-bdc8-a464050b81d7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:08.720711 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-5e761307-0e4d-4aa4-bdc8-a464050b81d7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:08.721879 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-5e761307-0e4d-4aa4-bdc8-a464050b81d7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1722 microversion: 2.20 time: 0.155733 Jul 07 10:35:08.722428 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 453/887] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:08 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:09.741808 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-cbd3f0ae-0792-4bdf-b7a6-e92bb9b0d6fe tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:09.742489 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-cbd3f0ae-0792-4bdf-b7a6-e92bb9b0d6fe tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:09.748780 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cbd3f0ae-0792-4bdf-b7a6-e92bb9b0d6fe tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:09.749225 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cbd3f0ae-0792-4bdf-b7a6-e92bb9b0d6fe tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:09.749973 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cbd3f0ae-0792-4bdf-b7a6-e92bb9b0d6fe tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:09.750403 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cbd3f0ae-0792-4bdf-b7a6-e92bb9b0d6fe tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:09.881837 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-cbd3f0ae-0792-4bdf-b7a6-e92bb9b0d6fe tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:09.889692 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-cbd3f0ae-0792-4bdf-b7a6-e92bb9b0d6fe tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:09.891188 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-cbd3f0ae-0792-4bdf-b7a6-e92bb9b0d6fe tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:09.892384 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-cbd3f0ae-0792-4bdf-b7a6-e92bb9b0d6fe tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1722 microversion: 2.20 time: 0.156017 Jul 07 10:35:09.892944 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 435/888] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:09 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:10.911564 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a679383e-e9b2-4315-9434-d751025db13f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:10.912335 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-a679383e-e9b2-4315-9434-d751025db13f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:10.918649 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a679383e-e9b2-4315-9434-d751025db13f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:10.919095 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a679383e-e9b2-4315-9434-d751025db13f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:10.919887 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a679383e-e9b2-4315-9434-d751025db13f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:10.920411 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a679383e-e9b2-4315-9434-d751025db13f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:11.048739 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-a679383e-e9b2-4315-9434-d751025db13f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:11.056686 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-a679383e-e9b2-4315-9434-d751025db13f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:11.058173 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-a679383e-e9b2-4315-9434-d751025db13f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:11.059322 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-a679383e-e9b2-4315-9434-d751025db13f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1722 microversion: 2.20 time: 0.152147 Jul 07 10:35:11.059893 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 454/889] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:10 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:12.077780 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-3b94dfd6-b858-4f41-987e-8b96d04605da tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:12.078389 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-3b94dfd6-b858-4f41-987e-8b96d04605da tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:12.085363 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3b94dfd6-b858-4f41-987e-8b96d04605da tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:12.085813 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3b94dfd6-b858-4f41-987e-8b96d04605da tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:12.086569 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3b94dfd6-b858-4f41-987e-8b96d04605da tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:12.087006 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3b94dfd6-b858-4f41-987e-8b96d04605da tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:12.215711 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-3b94dfd6-b858-4f41-987e-8b96d04605da tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:12.223734 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-3b94dfd6-b858-4f41-987e-8b96d04605da tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:12.225935 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-3b94dfd6-b858-4f41-987e-8b96d04605da tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:12.227094 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-3b94dfd6-b858-4f41-987e-8b96d04605da tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1722 microversion: 2.20 time: 0.153274 Jul 07 10:35:12.227680 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 436/890] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:12 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:13.245705 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-c68a157d-41d7-4415-9071-0053d6040cb4 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:13.246331 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-c68a157d-41d7-4415-9071-0053d6040cb4 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:13.252666 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c68a157d-41d7-4415-9071-0053d6040cb4 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:13.253110 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c68a157d-41d7-4415-9071-0053d6040cb4 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:13.253864 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c68a157d-41d7-4415-9071-0053d6040cb4 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:13.254296 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c68a157d-41d7-4415-9071-0053d6040cb4 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:13.379458 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-c68a157d-41d7-4415-9071-0053d6040cb4 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:13.387220 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-c68a157d-41d7-4415-9071-0053d6040cb4 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:13.388742 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-c68a157d-41d7-4415-9071-0053d6040cb4 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:13.389889 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-c68a157d-41d7-4415-9071-0053d6040cb4 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1722 microversion: 2.20 time: 0.148056 Jul 07 10:35:13.390438 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 455/891] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:13 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 10:35:14.408160 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-89a12158-c4a7-494d-8f8b-679807bf3a90 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:14.408690 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-89a12158-c4a7-494d-8f8b-679807bf3a90 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:14.415244 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-89a12158-c4a7-494d-8f8b-679807bf3a90 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:14.415691 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-89a12158-c4a7-494d-8f8b-679807bf3a90 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:14.416483 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-89a12158-c4a7-494d-8f8b-679807bf3a90 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:14.416921 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-89a12158-c4a7-494d-8f8b-679807bf3a90 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:14.542942 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-89a12158-c4a7-494d-8f8b-679807bf3a90 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:14.550753 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-89a12158-c4a7-494d-8f8b-679807bf3a90 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:14.552292 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-89a12158-c4a7-494d-8f8b-679807bf3a90 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:14.553454 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-89a12158-c4a7-494d-8f8b-679807bf3a90 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1722 microversion: 2.20 time: 0.149484 Jul 07 10:35:14.554012 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 437/892] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:14 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:15.571335 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-ccbb4ab9-9c6c-4486-bd8d-101dbfbc5c6a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:15.572001 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-ccbb4ab9-9c6c-4486-bd8d-101dbfbc5c6a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:15.578457 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ccbb4ab9-9c6c-4486-bd8d-101dbfbc5c6a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:15.578910 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ccbb4ab9-9c6c-4486-bd8d-101dbfbc5c6a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:15.579681 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ccbb4ab9-9c6c-4486-bd8d-101dbfbc5c6a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:15.580142 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ccbb4ab9-9c6c-4486-bd8d-101dbfbc5c6a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:15.704193 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-ccbb4ab9-9c6c-4486-bd8d-101dbfbc5c6a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:15.712811 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-ccbb4ab9-9c6c-4486-bd8d-101dbfbc5c6a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:15.714302 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-ccbb4ab9-9c6c-4486-bd8d-101dbfbc5c6a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:15.715458 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-ccbb4ab9-9c6c-4486-bd8d-101dbfbc5c6a tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1722 microversion: 2.20 time: 0.148046 Jul 07 10:35:15.716048 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 456/893] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:15 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:16.734162 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b8552222-5a04-4eed-ba35-08da540c4017 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:16.734821 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b8552222-5a04-4eed-ba35-08da540c4017 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:16.741846 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b8552222-5a04-4eed-ba35-08da540c4017 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:16.742306 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b8552222-5a04-4eed-ba35-08da540c4017 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:16.743072 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b8552222-5a04-4eed-ba35-08da540c4017 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:16.743511 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b8552222-5a04-4eed-ba35-08da540c4017 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:16.874462 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b8552222-5a04-4eed-ba35-08da540c4017 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:16.882365 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b8552222-5a04-4eed-ba35-08da540c4017 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:16.883917 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b8552222-5a04-4eed-ba35-08da540c4017 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:16.885111 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b8552222-5a04-4eed-ba35-08da540c4017 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1722 microversion: 2.20 time: 0.154849 Jul 07 10:35:16.885673 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 438/894] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:16 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:17.903119 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-ebe41d4f-45bc-4cd0-9057-fed87256540e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:17.903774 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-ebe41d4f-45bc-4cd0-9057-fed87256540e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:17.910258 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ebe41d4f-45bc-4cd0-9057-fed87256540e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:17.910705 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ebe41d4f-45bc-4cd0-9057-fed87256540e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:17.911469 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ebe41d4f-45bc-4cd0-9057-fed87256540e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:17.911940 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ebe41d4f-45bc-4cd0-9057-fed87256540e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:18.039997 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-ebe41d4f-45bc-4cd0-9057-fed87256540e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:18.047849 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-ebe41d4f-45bc-4cd0-9057-fed87256540e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:18.049344 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-ebe41d4f-45bc-4cd0-9057-fed87256540e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:18.050499 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-ebe41d4f-45bc-4cd0-9057-fed87256540e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1722 microversion: 2.20 time: 0.151271 Jul 07 10:35:18.051054 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 457/895] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:17 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:19.068943 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9759ab14-c029-4555-8013-61d06460f9a7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:19.070078 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-9759ab14-c029-4555-8013-61d06460f9a7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:19.076773 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9759ab14-c029-4555-8013-61d06460f9a7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:19.077217 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9759ab14-c029-4555-8013-61d06460f9a7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:19.077967 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9759ab14-c029-4555-8013-61d06460f9a7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:19.078396 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9759ab14-c029-4555-8013-61d06460f9a7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:19.204899 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9759ab14-c029-4555-8013-61d06460f9a7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:19.213252 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9759ab14-c029-4555-8013-61d06460f9a7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:19.214750 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9759ab14-c029-4555-8013-61d06460f9a7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:19.215934 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9759ab14-c029-4555-8013-61d06460f9a7 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1722 microversion: 2.20 time: 0.151087 Jul 07 10:35:19.216486 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 439/896] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:19 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:20.233747 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-065b4446-3f13-4bae-8ff4-ec8dbdf8ef47 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:20.234384 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-065b4446-3f13-4bae-8ff4-ec8dbdf8ef47 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:20.240782 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-065b4446-3f13-4bae-8ff4-ec8dbdf8ef47 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:20.241251 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-065b4446-3f13-4bae-8ff4-ec8dbdf8ef47 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:20.242005 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-065b4446-3f13-4bae-8ff4-ec8dbdf8ef47 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:20.242439 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-065b4446-3f13-4bae-8ff4-ec8dbdf8ef47 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:20.366818 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-065b4446-3f13-4bae-8ff4-ec8dbdf8ef47 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:20.374563 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-065b4446-3f13-4bae-8ff4-ec8dbdf8ef47 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:20.376078 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-065b4446-3f13-4bae-8ff4-ec8dbdf8ef47 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:20.377236 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-065b4446-3f13-4bae-8ff4-ec8dbdf8ef47 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1722 microversion: 2.20 time: 0.147392 Jul 07 10:35:20.377793 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 458/897] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:20 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:21.395113 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-777a4500-bd3f-4e3a-94ef-06aa64f12b66 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:21.395719 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-777a4500-bd3f-4e3a-94ef-06aa64f12b66 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:21.402200 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-777a4500-bd3f-4e3a-94ef-06aa64f12b66 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:21.402648 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-777a4500-bd3f-4e3a-94ef-06aa64f12b66 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:21.403404 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-777a4500-bd3f-4e3a-94ef-06aa64f12b66 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:21.403869 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-777a4500-bd3f-4e3a-94ef-06aa64f12b66 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:21.534779 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-777a4500-bd3f-4e3a-94ef-06aa64f12b66 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:21.543126 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-777a4500-bd3f-4e3a-94ef-06aa64f12b66 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:21.544648 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-777a4500-bd3f-4e3a-94ef-06aa64f12b66 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:21.545802 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-777a4500-bd3f-4e3a-94ef-06aa64f12b66 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1722 microversion: 2.20 time: 0.154717 Jul 07 10:35:21.546359 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 440/898] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:21 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:22.564869 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-f0d3b586-9a11-4f4e-8df3-f1950f0b9ede tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:22.565763 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-f0d3b586-9a11-4f4e-8df3-f1950f0b9ede tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:22.573119 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f0d3b586-9a11-4f4e-8df3-f1950f0b9ede tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:22.573570 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f0d3b586-9a11-4f4e-8df3-f1950f0b9ede tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:22.574342 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f0d3b586-9a11-4f4e-8df3-f1950f0b9ede tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:22.574791 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f0d3b586-9a11-4f4e-8df3-f1950f0b9ede tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:22.708512 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-f0d3b586-9a11-4f4e-8df3-f1950f0b9ede tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:22.716997 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-f0d3b586-9a11-4f4e-8df3-f1950f0b9ede tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:22.718504 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-f0d3b586-9a11-4f4e-8df3-f1950f0b9ede tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:22.719667 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-f0d3b586-9a11-4f4e-8df3-f1950f0b9ede tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1722 microversion: 2.20 time: 0.159132 Jul 07 10:35:22.720265 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 459/899] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:22 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:23.737555 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-71a1a159-37fd-4179-ba34-abe7b674b2e9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:23.738167 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-71a1a159-37fd-4179-ba34-abe7b674b2e9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:23.744630 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-71a1a159-37fd-4179-ba34-abe7b674b2e9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:23.745086 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-71a1a159-37fd-4179-ba34-abe7b674b2e9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:23.745846 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-71a1a159-37fd-4179-ba34-abe7b674b2e9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:23.746285 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-71a1a159-37fd-4179-ba34-abe7b674b2e9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:23.872831 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-71a1a159-37fd-4179-ba34-abe7b674b2e9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:23.880683 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-71a1a159-37fd-4179-ba34-abe7b674b2e9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:23.882190 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-71a1a159-37fd-4179-ba34-abe7b674b2e9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:23.884009 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-71a1a159-37fd-4179-ba34-abe7b674b2e9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1722 microversion: 2.20 time: 0.150357 Jul 07 10:35:23.884567 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 441/900] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:23 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:24.902522 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a0b20440-f871-4846-a6cf-4fd37777f0db tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:24.903123 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-a0b20440-f871-4846-a6cf-4fd37777f0db tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:24.909226 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a0b20440-f871-4846-a6cf-4fd37777f0db tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:24.909682 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a0b20440-f871-4846-a6cf-4fd37777f0db tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:24.910438 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a0b20440-f871-4846-a6cf-4fd37777f0db tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:24.910875 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a0b20440-f871-4846-a6cf-4fd37777f0db tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:25.034199 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-a0b20440-f871-4846-a6cf-4fd37777f0db tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:25.042407 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-a0b20440-f871-4846-a6cf-4fd37777f0db tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:25.043930 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-a0b20440-f871-4846-a6cf-4fd37777f0db tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:25.045079 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-a0b20440-f871-4846-a6cf-4fd37777f0db tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1743 microversion: 2.20 time: 0.146959 Jul 07 10:35:25.045623 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 460/901] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:24 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1743 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:26.063650 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-49514c96-33f7-429f-8877-2771dc4282b6 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:26.064325 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-49514c96-33f7-429f-8877-2771dc4282b6 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:26.071490 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-49514c96-33f7-429f-8877-2771dc4282b6 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:26.071972 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-49514c96-33f7-429f-8877-2771dc4282b6 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:26.072729 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-49514c96-33f7-429f-8877-2771dc4282b6 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:26.073163 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-49514c96-33f7-429f-8877-2771dc4282b6 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:26.207232 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-49514c96-33f7-429f-8877-2771dc4282b6 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:26.215345 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-49514c96-33f7-429f-8877-2771dc4282b6 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:26.216874 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-49514c96-33f7-429f-8877-2771dc4282b6 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:26.218279 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-49514c96-33f7-429f-8877-2771dc4282b6 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1743 microversion: 2.20 time: 0.158557 Jul 07 10:35:26.218842 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 442/902] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:26 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:27.237052 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-e4dc96f5-2d0a-48fb-b7d8-ed612bae66f9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:27.237641 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-e4dc96f5-2d0a-48fb-b7d8-ed612bae66f9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:27.244492 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e4dc96f5-2d0a-48fb-b7d8-ed612bae66f9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:27.245321 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e4dc96f5-2d0a-48fb-b7d8-ed612bae66f9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:27.246182 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e4dc96f5-2d0a-48fb-b7d8-ed612bae66f9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:27.247081 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e4dc96f5-2d0a-48fb-b7d8-ed612bae66f9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:27.397546 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-e4dc96f5-2d0a-48fb-b7d8-ed612bae66f9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:27.406781 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-e4dc96f5-2d0a-48fb-b7d8-ed612bae66f9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:27.408328 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-e4dc96f5-2d0a-48fb-b7d8-ed612bae66f9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:27.409554 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-e4dc96f5-2d0a-48fb-b7d8-ed612bae66f9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1738 microversion: 2.20 time: 0.176370 Jul 07 10:35:27.420998 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 461/903] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:27 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:28.054753 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-0d43cd34-f390-4ba7-8400-eb1c6fcce224 req-0c54ca84-a030-44dc-80f4-bc1458602aab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e66414c-2b54-4dcf-822c-96e90792fac7", "name": "network-vif-plugged", "status": "completed", "tag": "c7f05a17-2bf9-4c26-b60c-bf7c44c7df40"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:35:28.064347 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-0d43cd34-f390-4ba7-8400-eb1c6fcce224 req-0c54ca84-a030-44dc-80f4-bc1458602aab service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:28.064797 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-0d43cd34-f390-4ba7-8400-eb1c6fcce224 req-0c54ca84-a030-44dc-80f4-bc1458602aab service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:28.077158 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-0d43cd34-f390-4ba7-8400-eb1c6fcce224 req-0c54ca84-a030-44dc-80f4-bc1458602aab service nova] Creating event network-vif-plugged:c7f05a17-2bf9-4c26-b60c-bf7c44c7df40 for instance 0e66414c-2b54-4dcf-822c-96e90792fac7 on hv-cinder-82282 Jul 07 10:35:28.093602 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-0d43cd34-f390-4ba7-8400-eb1c6fcce224 req-0c54ca84-a030-44dc-80f4-bc1458602aab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044628 Jul 07 10:35:28.094879 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 443/904] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 10:35:28.428583 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-0bfc32ae-bba8-46dd-9b48-284d919b669e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:28.430100 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-0bfc32ae-bba8-46dd-9b48-284d919b669e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:28.436978 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0bfc32ae-bba8-46dd-9b48-284d919b669e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:28.437434 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0bfc32ae-bba8-46dd-9b48-284d919b669e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:28.438216 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0bfc32ae-bba8-46dd-9b48-284d919b669e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:28.438655 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0bfc32ae-bba8-46dd-9b48-284d919b669e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:28.578715 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-0bfc32ae-bba8-46dd-9b48-284d919b669e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:28.588329 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-0bfc32ae-bba8-46dd-9b48-284d919b669e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:28.590161 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-0bfc32ae-bba8-46dd-9b48-284d919b669e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:28.591425 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-0bfc32ae-bba8-46dd-9b48-284d919b669e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1738 microversion: 2.20 time: 0.166907 Jul 07 10:35:28.592239 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 462/905] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:28 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 10:35:29.610269 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-81e91ae0-3fe8-4608-b91f-2e7758eb7acc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:29.610984 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-81e91ae0-3fe8-4608-b91f-2e7758eb7acc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:29.618169 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-81e91ae0-3fe8-4608-b91f-2e7758eb7acc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:29.618884 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-81e91ae0-3fe8-4608-b91f-2e7758eb7acc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:29.619673 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-81e91ae0-3fe8-4608-b91f-2e7758eb7acc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:29.620170 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-81e91ae0-3fe8-4608-b91f-2e7758eb7acc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:29.766049 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-81e91ae0-3fe8-4608-b91f-2e7758eb7acc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:29.779173 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-81e91ae0-3fe8-4608-b91f-2e7758eb7acc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:29.780719 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-81e91ae0-3fe8-4608-b91f-2e7758eb7acc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:29.781900 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-81e91ae0-3fe8-4608-b91f-2e7758eb7acc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1738 microversion: 2.20 time: 0.176104 Jul 07 10:35:29.782683 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 444/906] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:29 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 10:35:30.800947 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-9574b2bd-5d32-4417-9ad5-da3dffafa89f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:30.802357 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-9574b2bd-5d32-4417-9ad5-da3dffafa89f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:30.810176 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9574b2bd-5d32-4417-9ad5-da3dffafa89f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:30.810639 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9574b2bd-5d32-4417-9ad5-da3dffafa89f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:30.811579 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9574b2bd-5d32-4417-9ad5-da3dffafa89f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:30.812060 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9574b2bd-5d32-4417-9ad5-da3dffafa89f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:30.954115 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-9574b2bd-5d32-4417-9ad5-da3dffafa89f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:30.964431 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-9574b2bd-5d32-4417-9ad5-da3dffafa89f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:30.965947 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-9574b2bd-5d32-4417-9ad5-da3dffafa89f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:30.967329 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-9574b2bd-5d32-4417-9ad5-da3dffafa89f tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1738 microversion: 2.20 time: 0.170577 Jul 07 10:35:30.967935 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 463/907] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:30 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:31.985556 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-64b63484-aee1-4abe-a98a-5633b776788b tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:31.987093 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-64b63484-aee1-4abe-a98a-5633b776788b tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:31.994982 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-64b63484-aee1-4abe-a98a-5633b776788b tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:31.995553 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-64b63484-aee1-4abe-a98a-5633b776788b tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:31.996548 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-64b63484-aee1-4abe-a98a-5633b776788b tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:31.996997 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-64b63484-aee1-4abe-a98a-5633b776788b tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:32.143107 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-64b63484-aee1-4abe-a98a-5633b776788b tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:32.157831 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-64b63484-aee1-4abe-a98a-5633b776788b tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:32.159471 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-64b63484-aee1-4abe-a98a-5633b776788b tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:32.160683 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-64b63484-aee1-4abe-a98a-5633b776788b tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1738 microversion: 2.20 time: 0.179729 Jul 07 10:35:32.161455 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 445/908] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:31 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:33.183722 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-da32122f-4528-4117-94fb-66b08a7f4082 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:33.184406 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-da32122f-4528-4117-94fb-66b08a7f4082 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:33.197168 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-da32122f-4528-4117-94fb-66b08a7f4082 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:33.198280 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-da32122f-4528-4117-94fb-66b08a7f4082 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:33.199660 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-da32122f-4528-4117-94fb-66b08a7f4082 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:33.200361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-da32122f-4528-4117-94fb-66b08a7f4082 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:33.345475 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-da32122f-4528-4117-94fb-66b08a7f4082 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:33.354774 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-da32122f-4528-4117-94fb-66b08a7f4082 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:33.356668 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-da32122f-4528-4117-94fb-66b08a7f4082 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:33.357858 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-da32122f-4528-4117-94fb-66b08a7f4082 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1738 microversion: 2.20 time: 0.178126 Jul 07 10:35:33.358644 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 464/909] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:33 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:34.376383 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9def39a9-2f30-429f-85eb-6b00864b1cd2 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:34.378494 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-9def39a9-2f30-429f-85eb-6b00864b1cd2 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:34.386186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9def39a9-2f30-429f-85eb-6b00864b1cd2 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:34.387075 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9def39a9-2f30-429f-85eb-6b00864b1cd2 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:34.388137 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9def39a9-2f30-429f-85eb-6b00864b1cd2 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:34.388580 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9def39a9-2f30-429f-85eb-6b00864b1cd2 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:34.539206 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9def39a9-2f30-429f-85eb-6b00864b1cd2 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:34.547882 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9def39a9-2f30-429f-85eb-6b00864b1cd2 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:34.549417 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9def39a9-2f30-429f-85eb-6b00864b1cd2 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:34.550670 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9def39a9-2f30-429f-85eb-6b00864b1cd2 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1738 microversion: 2.20 time: 0.178615 Jul 07 10:35:34.551254 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 446/910] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:34 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:35.569066 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-e24f337c-de47-4b23-9099-3aea9e9a4353 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:35.570166 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-e24f337c-de47-4b23-9099-3aea9e9a4353 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:35.576681 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e24f337c-de47-4b23-9099-3aea9e9a4353 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:35.577137 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e24f337c-de47-4b23-9099-3aea9e9a4353 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:35.577912 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e24f337c-de47-4b23-9099-3aea9e9a4353 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:35.578355 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-e24f337c-de47-4b23-9099-3aea9e9a4353 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:35.703066 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-e24f337c-de47-4b23-9099-3aea9e9a4353 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:35.711478 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-e24f337c-de47-4b23-9099-3aea9e9a4353 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:35.713035 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-e24f337c-de47-4b23-9099-3aea9e9a4353 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:35.714211 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-e24f337c-de47-4b23-9099-3aea9e9a4353 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1738 microversion: 2.20 time: 0.149414 Jul 07 10:35:35.714768 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 465/911] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:35 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:36.732639 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-aa3f5cfa-048e-4127-904e-1b65e1997427 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:36.733300 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-aa3f5cfa-048e-4127-904e-1b65e1997427 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:36.740026 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-aa3f5cfa-048e-4127-904e-1b65e1997427 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:36.740472 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-aa3f5cfa-048e-4127-904e-1b65e1997427 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:36.741226 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-aa3f5cfa-048e-4127-904e-1b65e1997427 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:36.741658 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-aa3f5cfa-048e-4127-904e-1b65e1997427 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:36.760114 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a234f8ed-6d25-4b6e-9604-ec2437752c63 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:36.760606 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-a234f8ed-6d25-4b6e-9604-ec2437752c63 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: b25327c6-c3ad-44eb-90ef-3ab8e86c426e] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:36.762855 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_api:SELECT=29 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:35:36.768688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a234f8ed-6d25-4b6e-9604-ec2437752c63 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:36.769147 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a234f8ed-6d25-4b6e-9604-ec2437752c63 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:36.769949 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a234f8ed-6d25-4b6e-9604-ec2437752c63 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:36.770388 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a234f8ed-6d25-4b6e-9604-ec2437752c63 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:36.773469 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=83 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:35:36.797385 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-a234f8ed-6d25-4b6e-9604-ec2437752c63 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e/ips" status: 200 len: 150 microversion: 2.1 time: 0.041211 Jul 07 10:35:36.797958 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 466/912] 10.222.0.16 () {58 vars in 1247 bytes} [Thu Jul 7 10:35:36 2022] GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:35:36.874162 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-aa3f5cfa-048e-4127-904e-1b65e1997427 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:36.882094 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-aa3f5cfa-048e-4127-904e-1b65e1997427 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:36.883708 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-aa3f5cfa-048e-4127-904e-1b65e1997427 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:36.884896 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-aa3f5cfa-048e-4127-904e-1b65e1997427 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1720 microversion: 2.20 time: 0.156162 Jul 07 10:35:36.885457 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 447/913] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:36 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:37.903269 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-23da8eaa-3faa-4657-b315-4fddc88aabad tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:37.903903 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-23da8eaa-3faa-4657-b315-4fddc88aabad tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:37.910507 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-23da8eaa-3faa-4657-b315-4fddc88aabad tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:37.910963 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-23da8eaa-3faa-4657-b315-4fddc88aabad tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:37.911812 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-23da8eaa-3faa-4657-b315-4fddc88aabad tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:37.912260 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-23da8eaa-3faa-4657-b315-4fddc88aabad tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:38.042499 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-23da8eaa-3faa-4657-b315-4fddc88aabad tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:38.050418 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-23da8eaa-3faa-4657-b315-4fddc88aabad tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:38.051935 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-23da8eaa-3faa-4657-b315-4fddc88aabad tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:38.053081 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-23da8eaa-3faa-4657-b315-4fddc88aabad tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1720 microversion: 2.20 time: 0.153793 Jul 07 10:35:38.054243 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 467/914] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:37 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:38.112084 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ae2635ac-7c2f-4996-9d92-24b3ea036dbd tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2bf7c2a5-84f8-47c0-8b3b-fe3491509e5f"}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:35:38.113150 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ae2635ac-7c2f-4996-9d92-24b3ea036dbd tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: b25327c6-c3ad-44eb-90ef-3ab8e86c426e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:38.120176 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ae2635ac-7c2f-4996-9d92-24b3ea036dbd tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:38.120628 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ae2635ac-7c2f-4996-9d92-24b3ea036dbd tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:38.121377 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ae2635ac-7c2f-4996-9d92-24b3ea036dbd tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:38.121806 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ae2635ac-7c2f-4996-9d92-24b3ea036dbd tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:38.298566 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:35:38.416620 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ae2635ac-7c2f-4996-9d92-24b3ea036dbd tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "POST /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308413 Jul 07 10:35:38.417254 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 448/915] 10.222.0.16 () {60 vars in 1322 bytes} [Thu Jul 7 10:35:38 2022] POST /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:35:39.072514 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-5088db55-19b1-4978-a0ee-888468377513 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:39.073135 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-5088db55-19b1-4978-a0ee-888468377513 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:39.079663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5088db55-19b1-4978-a0ee-888468377513 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:39.080159 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5088db55-19b1-4978-a0ee-888468377513 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:39.080927 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5088db55-19b1-4978-a0ee-888468377513 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:39.081372 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5088db55-19b1-4978-a0ee-888468377513 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:39.206992 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-5088db55-19b1-4978-a0ee-888468377513 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:39.215324 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-5088db55-19b1-4978-a0ee-888468377513 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:39.216865 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-5088db55-19b1-4978-a0ee-888468377513 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:39.218021 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-5088db55-19b1-4978-a0ee-888468377513 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1663 microversion: 2.20 time: 0.150247 Jul 07 10:35:39.218578 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 468/916] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:39 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1663 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:39.236827 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-23a46c68-271a-4a1e-ae90-525fb3369ef3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "804f518a-ffe5-4dca-a670-2795e1b0c680"}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:35:39.237965 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-23a46c68-271a-4a1e-ae90-525fb3369ef3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:39.239891 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=31 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:35:39.245335 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-23a46c68-271a-4a1e-ae90-525fb3369ef3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:39.245786 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-23a46c68-271a-4a1e-ae90-525fb3369ef3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:39.246548 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-23a46c68-271a-4a1e-ae90-525fb3369ef3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:39.246985 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-23a46c68-271a-4a1e-ae90-525fb3369ef3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:39.531404 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-23a46c68-271a-4a1e-ae90-525fb3369ef3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "POST /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.299362 Jul 07 10:35:39.532096 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 449/917] 10.222.0.16 () {62 vars in 1363 bytes} [Thu Jul 7 10:35:39 2022] POST /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7/os-volume_attachments => generated 188 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 10:35:39.641628 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-5eac681e-69a8-4643-ab72-3493b0d17552 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:39.642128 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-5eac681e-69a8-4643-ab72-3493b0d17552 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:39.648705 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5eac681e-69a8-4643-ab72-3493b0d17552 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:39.649168 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5eac681e-69a8-4643-ab72-3493b0d17552 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:39.649935 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5eac681e-69a8-4643-ab72-3493b0d17552 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:39.650377 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5eac681e-69a8-4643-ab72-3493b0d17552 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:39.870158 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-5eac681e-69a8-4643-ab72-3493b0d17552 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7/os-volume_attachments/804f518a-ffe5-4dca-a670-2795e1b0c680" status: 202 len: 0 microversion: 2.20 time: 0.232312 Jul 07 10:35:39.871195 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 469/918] 10.222.0.16 () {60 vars in 1456 bytes} [Thu Jul 7 10:35:39 2022] DELETE /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7/os-volume_attachments/804f518a-ffe5-4dca-a670-2795e1b0c680 => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 07 10:35:39.924673 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2c8047e5-1a75-44ec-bf16-6b5e43871627 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:35:39.925244 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-2c8047e5-1a75-44ec-bf16-6b5e43871627 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:39.932362 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2c8047e5-1a75-44ec-bf16-6b5e43871627 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:39.932819 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2c8047e5-1a75-44ec-bf16-6b5e43871627 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:39.933575 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2c8047e5-1a75-44ec-bf16-6b5e43871627 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:39.934014 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2c8047e5-1a75-44ec-bf16-6b5e43871627 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:40.025043 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-2c8047e5-1a75-44ec-bf16-6b5e43871627 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "POST /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7/action" status: 202 len: 0 microversion: 2.20 time: 0.104220 Jul 07 10:35:40.025694 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 450/919] 10.222.0.16 () {62 vars in 1318 bytes} [Thu Jul 7 10:35:39 2022] POST /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 07 10:35:40.034006 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-61be06cc-fcba-4a14-993d-0e06d54b9bb6 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:40.035404 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-61be06cc-fcba-4a14-993d-0e06d54b9bb6 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:40.041758 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-61be06cc-fcba-4a14-993d-0e06d54b9bb6 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:40.042283 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-61be06cc-fcba-4a14-993d-0e06d54b9bb6 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:40.043147 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-61be06cc-fcba-4a14-993d-0e06d54b9bb6 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:40.043937 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-61be06cc-fcba-4a14-993d-0e06d54b9bb6 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:40.113937 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-e1eb084c-efcf-4b3e-8e97-b62de089b579 req-136a0695-5784-4355-a1ef-cf68c411fe73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e66414c-2b54-4dcf-822c-96e90792fac7", "name": "network-vif-unplugged", "status": "completed", "tag": "c7f05a17-2bf9-4c26-b60c-bf7c44c7df40"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:35:40.127205 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-e1eb084c-efcf-4b3e-8e97-b62de089b579 req-136a0695-5784-4355-a1ef-cf68c411fe73 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:40.127648 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-e1eb084c-efcf-4b3e-8e97-b62de089b579 req-136a0695-5784-4355-a1ef-cf68c411fe73 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:40.140928 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.compute.server_external_events [req-e1eb084c-efcf-4b3e-8e97-b62de089b579 req-136a0695-5784-4355-a1ef-cf68c411fe73 service nova] Unable to find a host for instance 0e66414c-2b54-4dcf-822c-96e90792fac7. Dropping event network-vif-unplugged {{(pid=117647) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 07 10:35:40.141818 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-e1eb084c-efcf-4b3e-8e97-b62de089b579 req-136a0695-5784-4355-a1ef-cf68c411fe73 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032996 Jul 07 10:35:40.142401 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 451/920] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 07 10:35:40.195844 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-61be06cc-fcba-4a14-993d-0e06d54b9bb6 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:40.205681 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-61be06cc-fcba-4a14-993d-0e06d54b9bb6 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:40.207186 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-61be06cc-fcba-4a14-993d-0e06d54b9bb6 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:40.208674 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-61be06cc-fcba-4a14-993d-0e06d54b9bb6 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1671 microversion: 2.20 time: 0.178526 Jul 07 10:35:40.209441 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 470/921] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:40 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1671 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:41.227773 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-36049773-8208-4790-aabd-17afa9cbee85 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:41.228388 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-36049773-8208-4790-aabd-17afa9cbee85 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:41.234991 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-36049773-8208-4790-aabd-17afa9cbee85 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:41.235438 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-36049773-8208-4790-aabd-17afa9cbee85 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:41.236228 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-36049773-8208-4790-aabd-17afa9cbee85 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:41.236664 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-36049773-8208-4790-aabd-17afa9cbee85 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:41.461909 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-36049773-8208-4790-aabd-17afa9cbee85 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:41.469918 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-36049773-8208-4790-aabd-17afa9cbee85 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:41.471408 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-36049773-8208-4790-aabd-17afa9cbee85 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:41.472601 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-36049773-8208-4790-aabd-17afa9cbee85 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1729 microversion: 2.20 time: 0.248821 Jul 07 10:35:41.473158 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 452/922] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:41 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1729 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:42.491278 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a0f60d4a-97ed-4d23-a005-793a745885ea tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:42.496545 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-a0f60d4a-97ed-4d23-a005-793a745885ea tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:42.504890 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a0f60d4a-97ed-4d23-a005-793a745885ea tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:42.505610 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a0f60d4a-97ed-4d23-a005-793a745885ea tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:42.507093 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a0f60d4a-97ed-4d23-a005-793a745885ea tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:42.507697 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a0f60d4a-97ed-4d23-a005-793a745885ea tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:42.669009 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-a0f60d4a-97ed-4d23-a005-793a745885ea tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:42.677335 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-a0f60d4a-97ed-4d23-a005-793a745885ea tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:42.679519 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-a0f60d4a-97ed-4d23-a005-793a745885ea tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:42.680764 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-a0f60d4a-97ed-4d23-a005-793a745885ea tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1729 microversion: 2.20 time: 0.194201 Jul 07 10:35:42.681332 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 471/923] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:42 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1729 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:43.701796 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e33b2d28-7f12-48bf-a5d1-28c062922964 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:43.703298 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e33b2d28-7f12-48bf-a5d1-28c062922964 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:43.712023 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e33b2d28-7f12-48bf-a5d1-28c062922964 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:43.712484 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e33b2d28-7f12-48bf-a5d1-28c062922964 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:43.713383 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e33b2d28-7f12-48bf-a5d1-28c062922964 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:43.713907 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e33b2d28-7f12-48bf-a5d1-28c062922964 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:43.855199 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e33b2d28-7f12-48bf-a5d1-28c062922964 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:43.863793 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e33b2d28-7f12-48bf-a5d1-28c062922964 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:43.865445 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e33b2d28-7f12-48bf-a5d1-28c062922964 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:43.866843 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e33b2d28-7f12-48bf-a5d1-28c062922964 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1729 microversion: 2.20 time: 0.169294 Jul 07 10:35:43.867541 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 453/924] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:43 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:44.885806 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-1cb16cfd-14f9-4b72-a62b-27aa2795b5e9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:44.886532 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-1cb16cfd-14f9-4b72-a62b-27aa2795b5e9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:44.893437 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1cb16cfd-14f9-4b72-a62b-27aa2795b5e9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:44.893895 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1cb16cfd-14f9-4b72-a62b-27aa2795b5e9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:44.894670 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1cb16cfd-14f9-4b72-a62b-27aa2795b5e9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:44.895111 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1cb16cfd-14f9-4b72-a62b-27aa2795b5e9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:45.032792 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-1cb16cfd-14f9-4b72-a62b-27aa2795b5e9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:45.042494 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-1cb16cfd-14f9-4b72-a62b-27aa2795b5e9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:45.043971 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-1cb16cfd-14f9-4b72-a62b-27aa2795b5e9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:45.045226 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-1cb16cfd-14f9-4b72-a62b-27aa2795b5e9 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1729 microversion: 2.20 time: 0.164190 Jul 07 10:35:45.046001 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 472/925] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:44 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:46.069536 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-990d28f5-1385-4b4b-9726-7c0be25a5194 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:46.070124 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-990d28f5-1385-4b4b-9726-7c0be25a5194 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:46.077180 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-990d28f5-1385-4b4b-9726-7c0be25a5194 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:46.077643 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-990d28f5-1385-4b4b-9726-7c0be25a5194 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:46.078425 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-990d28f5-1385-4b4b-9726-7c0be25a5194 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:46.078865 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-990d28f5-1385-4b4b-9726-7c0be25a5194 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:46.222524 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-990d28f5-1385-4b4b-9726-7c0be25a5194 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:46.236410 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-990d28f5-1385-4b4b-9726-7c0be25a5194 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:46.237925 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-990d28f5-1385-4b4b-9726-7c0be25a5194 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:46.239095 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-990d28f5-1385-4b4b-9726-7c0be25a5194 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1729 microversion: 2.20 time: 0.180603 Jul 07 10:35:46.239654 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 454/926] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:46 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:47.258401 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-f2bc8568-9c8e-4c66-a54b-1fab85c0dcdd tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:47.259056 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-f2bc8568-9c8e-4c66-a54b-1fab85c0dcdd tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:47.265550 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f2bc8568-9c8e-4c66-a54b-1fab85c0dcdd tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:47.266003 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f2bc8568-9c8e-4c66-a54b-1fab85c0dcdd tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:47.266876 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f2bc8568-9c8e-4c66-a54b-1fab85c0dcdd tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:47.267366 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-f2bc8568-9c8e-4c66-a54b-1fab85c0dcdd tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:47.403455 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-f2bc8568-9c8e-4c66-a54b-1fab85c0dcdd tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:47.411848 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-f2bc8568-9c8e-4c66-a54b-1fab85c0dcdd tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:47.413584 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-f2bc8568-9c8e-4c66-a54b-1fab85c0dcdd tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:47.414785 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-f2bc8568-9c8e-4c66-a54b-1fab85c0dcdd tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1729 microversion: 2.20 time: 0.161108 Jul 07 10:35:47.415390 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 473/927] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:47 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 10:35:48.434774 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d03ce1a4-3418-43f4-8936-2477f00255bc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:48.435384 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d03ce1a4-3418-43f4-8936-2477f00255bc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:48.443293 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d03ce1a4-3418-43f4-8936-2477f00255bc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:48.443772 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d03ce1a4-3418-43f4-8936-2477f00255bc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:48.444712 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d03ce1a4-3418-43f4-8936-2477f00255bc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:48.445271 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d03ce1a4-3418-43f4-8936-2477f00255bc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:48.602245 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d03ce1a4-3418-43f4-8936-2477f00255bc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:48.611119 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d03ce1a4-3418-43f4-8936-2477f00255bc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:48.612674 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d03ce1a4-3418-43f4-8936-2477f00255bc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:48.613862 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d03ce1a4-3418-43f4-8936-2477f00255bc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1729 microversion: 2.20 time: 0.183010 Jul 07 10:35:48.614693 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 455/928] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:48 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 10:35:49.633859 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-6c7f7ae6-7f57-4480-bac7-263588457cb8 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:49.634473 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-6c7f7ae6-7f57-4480-bac7-263588457cb8 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:49.641349 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6c7f7ae6-7f57-4480-bac7-263588457cb8 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:49.641812 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6c7f7ae6-7f57-4480-bac7-263588457cb8 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:49.642595 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6c7f7ae6-7f57-4480-bac7-263588457cb8 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:49.643047 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6c7f7ae6-7f57-4480-bac7-263588457cb8 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:49.884591 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-6c7f7ae6-7f57-4480-bac7-263588457cb8 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:49.892822 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-6c7f7ae6-7f57-4480-bac7-263588457cb8 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:49.894474 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-6c7f7ae6-7f57-4480-bac7-263588457cb8 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:49.895648 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-6c7f7ae6-7f57-4480-bac7-263588457cb8 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1729 microversion: 2.20 time: 0.266325 Jul 07 10:35:49.896473 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 474/929] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:49 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1729 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 10:35:50.914370 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-20a8f77d-20c8-47e0-ba1a-cbedf7405ad3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:50.914992 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-20a8f77d-20c8-47e0-ba1a-cbedf7405ad3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:50.921773 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-20a8f77d-20c8-47e0-ba1a-cbedf7405ad3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:50.922178 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-20a8f77d-20c8-47e0-ba1a-cbedf7405ad3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:50.922941 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-20a8f77d-20c8-47e0-ba1a-cbedf7405ad3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:50.923384 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-20a8f77d-20c8-47e0-ba1a-cbedf7405ad3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:51.107114 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-20a8f77d-20c8-47e0-ba1a-cbedf7405ad3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:51.115312 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-20a8f77d-20c8-47e0-ba1a-cbedf7405ad3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:51.116915 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-20a8f77d-20c8-47e0-ba1a-cbedf7405ad3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:51.118105 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-20a8f77d-20c8-47e0-ba1a-cbedf7405ad3 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1729 microversion: 2.20 time: 0.208258 Jul 07 10:35:51.118662 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 456/930] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:50 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1729 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:52.136260 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-448747ee-a83c-42d0-94b9-af34d0441e32 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:52.136877 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-448747ee-a83c-42d0-94b9-af34d0441e32 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:52.143306 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-448747ee-a83c-42d0-94b9-af34d0441e32 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:52.143785 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-448747ee-a83c-42d0-94b9-af34d0441e32 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:52.144566 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-448747ee-a83c-42d0-94b9-af34d0441e32 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:52.145011 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-448747ee-a83c-42d0-94b9-af34d0441e32 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:52.276246 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-448747ee-a83c-42d0-94b9-af34d0441e32 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:52.284049 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-448747ee-a83c-42d0-94b9-af34d0441e32 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:52.285557 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-448747ee-a83c-42d0-94b9-af34d0441e32 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:52.286717 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-448747ee-a83c-42d0-94b9-af34d0441e32 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1729 microversion: 2.20 time: 0.154361 Jul 07 10:35:52.287796 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 475/931] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:52 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:53.305614 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-f118224f-e8ac-438c-9039-7ede3cdbfb6e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:53.306231 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-f118224f-e8ac-438c-9039-7ede3cdbfb6e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:53.308135 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-0a42ffa9-372f-445f-a032-f9e75e45449c tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2bf7c2a5-84f8-47c0-8b3b-fe3491509e5f"}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:35:53.309390 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-0a42ffa9-372f-445f-a032-f9e75e45449c tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: b25327c6-c3ad-44eb-90ef-3ab8e86c426e] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:53.313138 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f118224f-e8ac-438c-9039-7ede3cdbfb6e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:53.313592 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f118224f-e8ac-438c-9039-7ede3cdbfb6e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:53.314370 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f118224f-e8ac-438c-9039-7ede3cdbfb6e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:53.315072 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f118224f-e8ac-438c-9039-7ede3cdbfb6e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:53.315922 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0a42ffa9-372f-445f-a032-f9e75e45449c tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:53.316381 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0a42ffa9-372f-445f-a032-f9e75e45449c tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:53.317139 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0a42ffa9-372f-445f-a032-f9e75e45449c tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:53.317575 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0a42ffa9-372f-445f-a032-f9e75e45449c tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:53.395948 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.wsgi [None req-0a42ffa9-372f-445f-a032-f9e75e45449c tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] HTTP exception thrown: Invalid volume: volume 2bf7c2a5-84f8-47c0-8b3b-fe3491509e5f is already attached to instances: b25327c6-c3ad-44eb-90ef-3ab8e86c426e Jul 07 10:35:53.397713 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-0a42ffa9-372f-445f-a032-f9e75e45449c tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Request method failure captured: Jul 07 10:35:53.397713 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: POST /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e/os-volume_attachments HTTP/1.1 Jul 07 10:35:53.397713 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:35:53.397713 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:35:53.397713 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:35:53.397713 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 74 Jul 07 10:35:53.397713 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:35:53.397713 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:35:53.397713 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:35:53.397713 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:35:53.397713 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrY8OvCBMJnjRdOGiniYdWVQXRU5j_oL_-3IW8B050mI9iTiMiAqckVcFrYUNMDNBzu5A7KjWAw4CfsePxF_lhVKdStuWP73EE48s908WgfQ_p-BUvui7Lff6JDUFqsZcmbVchhpCEcFgE514wUYqWgw2aG015Cpl2jakkhdOE3Gcxc Jul 07 10:35:53.397713 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:35:53.397713 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:35:53.397713 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:35:53.397713 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:35:53.397713 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:35:53.397713 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:35:53.397713 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: 1568d5b1c4bb471f9de53f4d5cf7cc82 Jul 07 10:35:53.397713 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:35:53.397713 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:35:53.397713 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:35:53.399185 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:35:53.399185 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:35:53.399185 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: 1568d5b1c4bb471f9de53f4d5cf7cc82 Jul 07 10:35:53.399185 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:35:53.399185 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-AttachVolumeNegativeTest-1710795981-project Jul 07 10:35:53.399185 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:35:53.399185 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:35:53.399185 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: 1222d8bb50554d64ac674f109b6ad077 Jul 07 10:35:53.399185 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-AttachVolumeNegativeTest-1710795981-project Jul 07 10:35:53.399185 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Jul 07 10:35:53.399185 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {"volumeAttachment": {"volumeId": "2bf7c2a5-84f8-47c0-8b3b-fe3491509e5f"}} Jul 07 10:35:53.399185 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: > Jul 07 10:35:53.400468 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Invalid volume: volume 2bf7c2a5-84f8-47c0-8b3b-fe3491509e5f is already attached to instances: b25327c6-c3ad-44eb-90ef-3ab8e86c426e Jul 07 10:35:53.400468 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'server_id': 'b25327c6-c3ad-44eb-90ef-3ab8e86c426e', 'body': {'volumeAttachment': {'volumeId': '2bf7c2a5-84f8-47c0-8b3b-fe3491509e5f'}}} Jul 07 10:35:53.400468 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:35:53.400468 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:35:53.400468 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 07 10:35:53.400468 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 07 10:35:53.400468 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 07 10:35:53.400468 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 07 10:35:53.400468 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 07 10:35:53.400468 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 07 10:35:53.400468 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 07 10:35:53.400468 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 07 10:35:53.400468 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 07 10:35:53.400468 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 07 10:35:53.400468 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2bf7c2a5-84f8-47c0-8b3b-fe3491509e5f is already attached to instances: b25327c6-c3ad-44eb-90ef-3ab8e86c426e Jul 07 10:35:53.400468 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:35:53.400468 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:35:53.400468 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:35:53.400468 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:35:53.401938 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:35:53.401938 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:35:53.401938 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:35:53.401938 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:35:53.401938 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:35:53.401938 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:35:53.401938 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 10:35:53.401938 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 10:35:53.401938 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 10:35:53.401938 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 10:35:53.401938 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 10:35:53.401938 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 10:35:53.401938 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 07 10:35:53.401938 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 07 10:35:53.401938 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2bf7c2a5-84f8-47c0-8b3b-fe3491509e5f is already attached to instances: b25327c6-c3ad-44eb-90ef-3ab8e86c426e Jul 07 10:35:53.401938 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:35:53.401938 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:35:53.401938 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:35:53.401938 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:35:53.401938 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:35:53.404021 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:35:53.404021 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:35:53.404021 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:35:53.404021 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2bf7c2a5-84f8-47c0-8b3b-fe3491509e5f is already attached to instances: b25327c6-c3ad-44eb-90ef-3ab8e86c426e Jul 07 10:35:53.404021 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:35:53.404021 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-0a42ffa9-372f-445f-a032-f9e75e45449c tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Returning 400 to user: Invalid volume: volume 2bf7c2a5-84f8-47c0-8b3b-fe3491509e5f is already attached to instances: b25327c6-c3ad-44eb-90ef-3ab8e86c426e {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:35:53.404021 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-0a42ffa9-372f-445f-a032-f9e75e45449c tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "POST /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096247 Jul 07 10:35:53.404021 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 476/932] 10.222.0.16 () {60 vars in 1322 bytes} [Thu Jul 7 10:35:53 2022] POST /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 07 10:35:53.445407 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f118224f-e8ac-438c-9039-7ede3cdbfb6e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:53.453502 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f118224f-e8ac-438c-9039-7ede3cdbfb6e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:53.454974 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f118224f-e8ac-438c-9039-7ede3cdbfb6e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:53.456182 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-f118224f-e8ac-438c-9039-7ede3cdbfb6e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1729 microversion: 2.20 time: 0.155016 Jul 07 10:35:53.456738 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 457/933] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:53 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:53.463711 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-7bc563b3-307a-48d3-9e34-f7da626f5d84 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:53.464235 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-7bc563b3-307a-48d3-9e34-f7da626f5d84 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: b25327c6-c3ad-44eb-90ef-3ab8e86c426e] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:53.470337 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7bc563b3-307a-48d3-9e34-f7da626f5d84 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:53.470786 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7bc563b3-307a-48d3-9e34-f7da626f5d84 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:53.471556 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7bc563b3-307a-48d3-9e34-f7da626f5d84 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:53.472040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7bc563b3-307a-48d3-9e34-f7da626f5d84 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:53.550546 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.objects.instance [None req-7bc563b3-307a-48d3-9e34-f7da626f5d84 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lazy-loading 'services' on Instance uuid b25327c6-c3ad-44eb-90ef-3ab8e86c426e {{(pid=117646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 10:35:53.622316 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-7bc563b3-307a-48d3-9e34-f7da626f5d84 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e/os-volume_attachments/2bf7c2a5-84f8-47c0-8b3b-fe3491509e5f" status: 202 len: 0 microversion: 2.1 time: 0.162266 Jul 07 10:35:53.623069 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 477/934] 10.222.0.16 () {58 vars in 1415 bytes} [Thu Jul 7 10:35:53 2022] DELETE /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e/os-volume_attachments/2bf7c2a5-84f8-47c0-8b3b-fe3491509e5f => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 10:35:53.631798 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b8ccf676-2c69-4c5a-966a-eb7ef7a72c67 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:53.632823 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b8ccf676-2c69-4c5a-966a-eb7ef7a72c67 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: b25327c6-c3ad-44eb-90ef-3ab8e86c426e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:53.638848 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b8ccf676-2c69-4c5a-966a-eb7ef7a72c67 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:53.639401 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b8ccf676-2c69-4c5a-966a-eb7ef7a72c67 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:53.640238 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b8ccf676-2c69-4c5a-966a-eb7ef7a72c67 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:53.640762 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b8ccf676-2c69-4c5a-966a-eb7ef7a72c67 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:53.672068 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b8ccf676-2c69-4c5a-966a-eb7ef7a72c67 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044542 Jul 07 10:35:53.672637 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 458/935] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jul 7 10:35:53 2022] GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 10:35:54.474285 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-9186a5c4-2547-413b-833e-8d11aac878bc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:54.475588 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-9186a5c4-2547-413b-833e-8d11aac878bc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:54.482255 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9186a5c4-2547-413b-833e-8d11aac878bc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:54.482733 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9186a5c4-2547-413b-833e-8d11aac878bc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:54.483525 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9186a5c4-2547-413b-833e-8d11aac878bc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:54.483996 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-9186a5c4-2547-413b-833e-8d11aac878bc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:54.614199 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-9186a5c4-2547-413b-833e-8d11aac878bc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:54.622712 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-9186a5c4-2547-413b-833e-8d11aac878bc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:54.624260 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-9186a5c4-2547-413b-833e-8d11aac878bc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:54.625431 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-9186a5c4-2547-413b-833e-8d11aac878bc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1729 microversion: 2.20 time: 0.155468 Jul 07 10:35:54.626135 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 478/936] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:54 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:54.683793 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-682b3544-1401-4810-a707-038392c61504 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:54.684742 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-682b3544-1401-4810-a707-038392c61504 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: b25327c6-c3ad-44eb-90ef-3ab8e86c426e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:54.691472 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-682b3544-1401-4810-a707-038392c61504 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:54.691962 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-682b3544-1401-4810-a707-038392c61504 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:54.692720 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-682b3544-1401-4810-a707-038392c61504 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:54.693156 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-682b3544-1401-4810-a707-038392c61504 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:54.723224 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-682b3544-1401-4810-a707-038392c61504 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043571 Jul 07 10:35:54.723790 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 459/937] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jul 7 10:35:54 2022] GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 10:35:54.779307 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-554230c0-781b-46da-b20e-85f0676be2d2 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:54.779831 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-554230c0-781b-46da-b20e-85f0676be2d2 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: b25327c6-c3ad-44eb-90ef-3ab8e86c426e] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:54.785768 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-554230c0-781b-46da-b20e-85f0676be2d2 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:54.786219 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-554230c0-781b-46da-b20e-85f0676be2d2 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:54.786974 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-554230c0-781b-46da-b20e-85f0676be2d2 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:54.788009 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-554230c0-781b-46da-b20e-85f0676be2d2 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:54.814234 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-554230c0-781b-46da-b20e-85f0676be2d2 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: b25327c6-c3ad-44eb-90ef-3ab8e86c426e] Going to try to terminate instance {{(pid=117646) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 10:35:54.817235 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:35:54.889110 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-554230c0-781b-46da-b20e-85f0676be2d2 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e" status: 204 len: 0 microversion: 2.1 time: 0.113403 Jul 07 10:35:54.889889 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 479/938] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jul 7 10:35:54 2022] DELETE /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 10:35:54.898745 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2066f997-64c1-458b-8231-d0c54906df61 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:54.899377 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-2066f997-64c1-458b-8231-d0c54906df61 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: b25327c6-c3ad-44eb-90ef-3ab8e86c426e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:54.905362 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2066f997-64c1-458b-8231-d0c54906df61 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:54.905807 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2066f997-64c1-458b-8231-d0c54906df61 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:54.906558 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2066f997-64c1-458b-8231-d0c54906df61 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:54.906986 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2066f997-64c1-458b-8231-d0c54906df61 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:55.035372 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-2066f997-64c1-458b-8231-d0c54906df61 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:55.042772 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-2066f997-64c1-458b-8231-d0c54906df61 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e" status: 200 len: 1683 microversion: 2.1 time: 0.148546 Jul 07 10:35:55.043329 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 460/939] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:35:54 2022] GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:35:55.644295 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-8d08ff5e-854f-4823-b305-da1c027f8eff tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:55.644990 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-8d08ff5e-854f-4823-b305-da1c027f8eff tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:55.651909 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8d08ff5e-854f-4823-b305-da1c027f8eff tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:55.652364 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8d08ff5e-854f-4823-b305-da1c027f8eff tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:55.653121 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8d08ff5e-854f-4823-b305-da1c027f8eff tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:55.653560 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8d08ff5e-854f-4823-b305-da1c027f8eff tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:56.004477 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-8d08ff5e-854f-4823-b305-da1c027f8eff tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:56.012812 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-8d08ff5e-854f-4823-b305-da1c027f8eff tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:56.014327 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-8d08ff5e-854f-4823-b305-da1c027f8eff tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:56.015480 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-8d08ff5e-854f-4823-b305-da1c027f8eff tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1729 microversion: 2.20 time: 0.375534 Jul 07 10:35:56.016066 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 480/940] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:55 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1729 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:56.060060 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-742cc87f-015a-4ac0-a860-c69411342406 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:56.060676 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-742cc87f-015a-4ac0-a860-c69411342406 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: b25327c6-c3ad-44eb-90ef-3ab8e86c426e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:56.067290 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-742cc87f-015a-4ac0-a860-c69411342406 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:56.067761 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-742cc87f-015a-4ac0-a860-c69411342406 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:56.069054 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-742cc87f-015a-4ac0-a860-c69411342406 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:56.069488 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-742cc87f-015a-4ac0-a860-c69411342406 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:56.084801 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:UPDATE=7,nova_cell1:SELECT=88,nova_cell1:INSERT=5 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:35:56.200216 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-742cc87f-015a-4ac0-a860-c69411342406 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:56.208085 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-742cc87f-015a-4ac0-a860-c69411342406 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e" status: 200 len: 1683 microversion: 2.1 time: 0.151770 Jul 07 10:35:56.208648 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 461/941] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:35:56 2022] GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:35:56.211079 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-1a070a13-6b29-4961-9555-0cc36aadffde req-1d05136b-c8df-425b-abf1-e5b68ecfc64d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e66414c-2b54-4dcf-822c-96e90792fac7", "name": "network-vif-plugged", "status": "completed", "tag": "c7f05a17-2bf9-4c26-b60c-bf7c44c7df40"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:35:56.219536 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-1a070a13-6b29-4961-9555-0cc36aadffde req-1d05136b-c8df-425b-abf1-e5b68ecfc64d service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:56.220085 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-1a070a13-6b29-4961-9555-0cc36aadffde req-1d05136b-c8df-425b-abf1-e5b68ecfc64d service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:56.231725 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-1a070a13-6b29-4961-9555-0cc36aadffde req-1d05136b-c8df-425b-abf1-e5b68ecfc64d service nova] Creating event network-vif-plugged:c7f05a17-2bf9-4c26-b60c-bf7c44c7df40 for instance 0e66414c-2b54-4dcf-822c-96e90792fac7 on hv-cinder-82282 Jul 07 10:35:56.236428 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-1a070a13-6b29-4961-9555-0cc36aadffde req-1d05136b-c8df-425b-abf1-e5b68ecfc64d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029512 Jul 07 10:35:56.237016 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 481/942] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 10:35:57.034124 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e1497bb9-438f-490e-b073-92ce7cbeb467 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:57.034758 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e1497bb9-438f-490e-b073-92ce7cbeb467 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:57.040818 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e1497bb9-438f-490e-b073-92ce7cbeb467 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:57.041263 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e1497bb9-438f-490e-b073-92ce7cbeb467 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:57.042023 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e1497bb9-438f-490e-b073-92ce7cbeb467 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:57.042481 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e1497bb9-438f-490e-b073-92ce7cbeb467 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:57.225957 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-1a73df0c-5f7c-40ef-af83-2245c6bc8d68 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:57.226683 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-1a73df0c-5f7c-40ef-af83-2245c6bc8d68 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: b25327c6-c3ad-44eb-90ef-3ab8e86c426e] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:57.232820 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1a73df0c-5f7c-40ef-af83-2245c6bc8d68 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:57.233267 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1a73df0c-5f7c-40ef-af83-2245c6bc8d68 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:57.234023 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1a73df0c-5f7c-40ef-af83-2245c6bc8d68 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:57.234460 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1a73df0c-5f7c-40ef-af83-2245c6bc8d68 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:57.276316 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e1497bb9-438f-490e-b073-92ce7cbeb467 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:57.284595 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e1497bb9-438f-490e-b073-92ce7cbeb467 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:57.286131 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e1497bb9-438f-490e-b073-92ce7cbeb467 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:57.287935 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e1497bb9-438f-490e-b073-92ce7cbeb467 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1729 microversion: 2.20 time: 0.257829 Jul 07 10:35:57.288565 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 462/943] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:57 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1729 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:57.365867 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-1a73df0c-5f7c-40ef-af83-2245c6bc8d68 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:57.373615 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-1a73df0c-5f7c-40ef-af83-2245c6bc8d68 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e" status: 200 len: 1683 microversion: 2.1 time: 0.152294 Jul 07 10:35:57.374191 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 482/944] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:35:57 2022] GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:35:58.000532 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-a56749a4-e7e9-404b-be50-0bc153ef6cce req-a980b3b8-9511-4ffc-9550-2ac60dd85f36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b25327c6-c3ad-44eb-90ef-3ab8e86c426e", "name": "network-vif-deleted", "tag": "ae026b25-1a96-48c6-878b-9c0ba70416c5"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:35:58.009644 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-a56749a4-e7e9-404b-be50-0bc153ef6cce req-a980b3b8-9511-4ffc-9550-2ac60dd85f36 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:58.010105 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-a56749a4-e7e9-404b-be50-0bc153ef6cce req-a980b3b8-9511-4ffc-9550-2ac60dd85f36 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:58.021713 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-a56749a4-e7e9-404b-be50-0bc153ef6cce req-a980b3b8-9511-4ffc-9550-2ac60dd85f36 service nova] Creating event network-vif-deleted:ae026b25-1a96-48c6-878b-9c0ba70416c5 for instance b25327c6-c3ad-44eb-90ef-3ab8e86c426e on hv-cinder-82282 Jul 07 10:35:58.026749 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-a56749a4-e7e9-404b-be50-0bc153ef6cce req-a980b3b8-9511-4ffc-9550-2ac60dd85f36 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030393 Jul 07 10:35:58.027385 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 463/945] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:35:58.307049 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-bdeae2ab-d6a0-4ef9-9cc0-9b07de1c6f11 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:58.307636 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-bdeae2ab-d6a0-4ef9-9cc0-9b07de1c6f11 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:58.314055 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bdeae2ab-d6a0-4ef9-9cc0-9b07de1c6f11 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:58.314511 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bdeae2ab-d6a0-4ef9-9cc0-9b07de1c6f11 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:58.315541 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bdeae2ab-d6a0-4ef9-9cc0-9b07de1c6f11 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:58.316013 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-bdeae2ab-d6a0-4ef9-9cc0-9b07de1c6f11 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:58.391389 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-3d2050cd-21f5-4509-a086-78153c9d74e0 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:58.392118 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-3d2050cd-21f5-4509-a086-78153c9d74e0 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: b25327c6-c3ad-44eb-90ef-3ab8e86c426e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:58.399414 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3d2050cd-21f5-4509-a086-78153c9d74e0 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:58.400159 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3d2050cd-21f5-4509-a086-78153c9d74e0 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:58.401153 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3d2050cd-21f5-4509-a086-78153c9d74e0 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:58.401789 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3d2050cd-21f5-4509-a086-78153c9d74e0 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:58.435178 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3d2050cd-21f5-4509-a086-78153c9d74e0 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:58.435708 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3d2050cd-21f5-4509-a086-78153c9d74e0 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:58.436261 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.objects.instance [None req-3d2050cd-21f5-4509-a086-78153c9d74e0 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lazy-loading 'fault' on Instance uuid b25327c6-c3ad-44eb-90ef-3ab8e86c426e {{(pid=117647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 10:35:58.482111 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-bdeae2ab-d6a0-4ef9-9cc0-9b07de1c6f11 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:58.495113 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-bdeae2ab-d6a0-4ef9-9cc0-9b07de1c6f11 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:58.508450 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-bdeae2ab-d6a0-4ef9-9cc0-9b07de1c6f11 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:58.509691 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-bdeae2ab-d6a0-4ef9-9cc0-9b07de1c6f11 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1729 microversion: 2.20 time: 0.207254 Jul 07 10:35:58.523009 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 483/946] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:58 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1729 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:35:58.526027 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-3d2050cd-21f5-4509-a086-78153c9d74e0 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:58.535865 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-3d2050cd-21f5-4509-a086-78153c9d74e0 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e" status: 200 len: 1332 microversion: 2.1 time: 0.149055 Jul 07 10:35:58.537481 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 464/947] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:35:58 2022] GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e => generated 1332 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:35:59.527151 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a9804a97-3d49-44b3-8d53-a8e986704aa1 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:59.527777 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-a9804a97-3d49-44b3-8d53-a8e986704aa1 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:59.534157 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a9804a97-3d49-44b3-8d53-a8e986704aa1 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:59.534608 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a9804a97-3d49-44b3-8d53-a8e986704aa1 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:59.535365 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a9804a97-3d49-44b3-8d53-a8e986704aa1 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:59.535825 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a9804a97-3d49-44b3-8d53-a8e986704aa1 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:59.554026 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5a943236-9023-405e-9d3e-bbcddeae23db tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:59.554737 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5a943236-9023-405e-9d3e-bbcddeae23db tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: b25327c6-c3ad-44eb-90ef-3ab8e86c426e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:35:59.561146 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5a943236-9023-405e-9d3e-bbcddeae23db tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:59.561603 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5a943236-9023-405e-9d3e-bbcddeae23db tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:59.562373 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5a943236-9023-405e-9d3e-bbcddeae23db tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:35:59.562811 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5a943236-9023-405e-9d3e-bbcddeae23db tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:35:59.576354 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-5a943236-9023-405e-9d3e-bbcddeae23db tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] HTTP exception thrown: Instance b25327c6-c3ad-44eb-90ef-3ab8e86c426e could not be found. Jul 07 10:35:59.578024 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5a943236-9023-405e-9d3e-bbcddeae23db tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Request method failure captured: Jul 07 10:35:59.578024 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e HTTP/1.1 Jul 07 10:35:59.578024 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept: application/json Jul 07 10:35:59.578024 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jul 07 10:35:59.578024 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Connection: close Jul 07 10:35:59.578024 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jul 07 10:35:59.578024 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jul 07 10:35:59.578024 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Host: 10.222.0.16 Jul 07 10:35:59.578024 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jul 07 10:35:59.578024 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jul 07 10:35:59.578024 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABixrY8OvCBMJnjRdOGiniYdWVQXRU5j_oL_-3IW8B050mI9iTiMiAqckVcFrYUNMDNBzu5A7KjWAw4CfsePxF_lhVKdStuWP73EE48s908WgfQ_p-BUvui7Lff6JDUFqsZcmbVchhpCEcFgE514wUYqWgw2aG015Cpl2jakkhdOE3Gcxc Jul 07 10:35:59.578024 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jul 07 10:35:59.578024 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jul 07 10:35:59.578024 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jul 07 10:35:59.578024 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jul 07 10:35:59.578024 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jul 07 10:35:59.578024 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jul 07 10:35:59.578024 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Id: 1568d5b1c4bb471f9de53f4d5cf7cc82 Jul 07 10:35:59.578024 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:35:59.578024 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jul 07 10:35:59.578024 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jul 07 10:35:59.579612 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:35:59.579612 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:35:59.579612 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 1568d5b1c4bb471f9de53f4d5cf7cc82 Jul 07 10:35:59.579612 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:35:59.579612 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User: tempest-AttachVolumeNegativeTest-1710795981-project Jul 07 10:35:59.579612 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jul 07 10:35:59.579612 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jul 07 10:35:59.579612 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Id: 1222d8bb50554d64ac674f109b6ad077 Jul 07 10:35:59.579612 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-AttachVolumeNegativeTest-1710795981-project Jul 07 10:35:59.579612 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: method: > Jul 07 10:35:59.579612 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: exception: Instance b25327c6-c3ad-44eb-90ef-3ab8e86c426e could not be found. Jul 07 10:35:59.579612 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: action_args: {'id': 'b25327c6-c3ad-44eb-90ef-3ab8e86c426e'} Jul 07 10:35:59.580503 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:35:59.580503 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:35:59.580503 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:35:59.580503 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:35:59.580503 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:35:59.580503 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:35:59.580503 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:35:59.580503 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:35:59.580503 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:35:59.580503 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:35:59.580503 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b25327c6-c3ad-44eb-90ef-3ab8e86c426e could not be found. Jul 07 10:35:59.580503 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:35:59.580503 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:35:59.580503 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:35:59.580503 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:35:59.580503 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:35:59.580503 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:35:59.580503 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:35:59.580503 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:35:59.580503 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:35:59.581952 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:35:59.581952 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:35:59.581952 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:35:59.581952 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:35:59.581952 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:35:59.581952 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:35:59.581952 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:35:59.581952 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b25327c6-c3ad-44eb-90ef-3ab8e86c426e could not be found. Jul 07 10:35:59.581952 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:35:59.581952 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:35:59.581952 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:35:59.581952 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:35:59.581952 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:35:59.581952 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:35:59.581952 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:35:59.581952 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:35:59.581952 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b25327c6-c3ad-44eb-90ef-3ab8e86c426e could not be found. Jul 07 10:35:59.581952 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:35:59.583522 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5a943236-9023-405e-9d3e-bbcddeae23db tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Returning 404 to user: Instance b25327c6-c3ad-44eb-90ef-3ab8e86c426e could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:35:59.583522 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5a943236-9023-405e-9d3e-bbcddeae23db tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e" status: 404 len: 111 microversion: 2.1 time: 0.029957 Jul 07 10:35:59.583522 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 465/948] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:35:59 2022] GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 07 10:35:59.588029 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-769b7961-1767-4cb2-98f5-f2dc9ce3b325 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '.version_select at 0x7f9e9e5815e0>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:35:59.605392 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-769b7961-1767-4cb2-98f5-f2dc9ce3b325 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1347189530" status: 202 len: 0 microversion: 2.1 time: 0.020890 Jul 07 10:35:59.605957 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 466/949] 10.222.0.16 () {58 vars in 1220 bytes} [Thu Jul 7 10:35:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1347189530 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 10:35:59.668316 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-a9804a97-3d49-44b3-8d53-a8e986704aa1 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:59.676213 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-a9804a97-3d49-44b3-8d53-a8e986704aa1 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:59.677808 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-a9804a97-3d49-44b3-8d53-a8e986704aa1 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:35:59.679020 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-a9804a97-3d49-44b3-8d53-a8e986704aa1 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1716 microversion: 2.20 time: 0.155782 Jul 07 10:35:59.679589 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 484/950] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:35:59 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:36:00.205237 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9bd5a95f-cf23-46b9-ad0b-9a76da83a7ff tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Action: 'create', calling method: .version_select at 0x7f9e9ef201f0>, body: {"keypair": {"name": "tempest-keypair-1353623448", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJazw3ublbdlV0PXcU+ci+bh/3uucugDWSSrvV52SG09rqb+tcR+4z8GUXf3FFPwHEXyXUaKmAZ1/pQ18TLrvEkhzGdAottBLx0PqsYITjRobzloCpvRWrOipgASWe85Jg=="}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:36:00.219668 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-9bd5a95f-cf23-46b9-ad0b-9a76da83a7ff tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Getting quotas for project 1568d5b1c4bb471f9de53f4d5cf7cc82. Resources: {'key_pairs'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:36:00.223424 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-9bd5a95f-cf23-46b9-ad0b-9a76da83a7ff tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Getting quotas for user 1222d8bb50554d64ac674f109b6ad077 and project 1568d5b1c4bb471f9de53f4d5cf7cc82. Resources: {'key_pairs'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:36:00.244855 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9bd5a95f-cf23-46b9-ad0b-9a76da83a7ff tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043616 Jul 07 10:36:00.245431 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 467/951] 10.222.0.16 () {60 vars in 1158 bytes} [Thu Jul 7 10:36:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:36:01.667702 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-6ec0540b-1c99-42a9-a1df-7acd2d27ea5d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1100625021", "imageRef": "1c96509d-f65f-42b0-94b3-6fc590a93508", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ddda3840-6dd5-4197-ae4c-bd6a56e53d5c"}], "security_groups": [{"name": "tempest-securitygroup--672449955"}], "key_name": "tempest-keypair-1353623448", "user_data": "}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:36:01.772423 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.network.neutron [None req-6ec0540b-1c99-42a9-a1df-7acd2d27ea5d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] validate_networks() for [('ddda3840-6dd5-4197-ae4c-bd6a56e53d5c', None, None, None, None, None)] {{(pid=117646) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 10:36:02.128015 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-6ec0540b-1c99-42a9-a1df-7acd2d27ea5d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Flavor limits 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 10:36:02.128441 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-6ec0540b-1c99-42a9-a1df-7acd2d27ea5d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Image limits 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 10:36:02.128914 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-6ec0540b-1c99-42a9-a1df-7acd2d27ea5d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Flavor pref 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 10:36:02.129320 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-6ec0540b-1c99-42a9-a1df-7acd2d27ea5d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Image pref 0:0:0 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 10:36:02.129730 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.virt.hardware [None req-6ec0540b-1c99-42a9-a1df-7acd2d27ea5d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 10:36:02.138475 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6ec0540b-1c99-42a9-a1df-7acd2d27ea5d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:02.138919 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6ec0540b-1c99-42a9-a1df-7acd2d27ea5d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:02.139705 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6ec0540b-1c99-42a9-a1df-7acd2d27ea5d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:02.140170 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6ec0540b-1c99-42a9-a1df-7acd2d27ea5d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:02.156769 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-6ec0540b-1c99-42a9-a1df-7acd2d27ea5d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Getting quotas for project 1568d5b1c4bb471f9de53f4d5cf7cc82. Resources: {'cores', 'ram', 'instances'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 10:36:02.160670 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.quota [None req-6ec0540b-1c99-42a9-a1df-7acd2d27ea5d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Getting quotas for user 1222d8bb50554d64ac674f109b6ad077 and project 1568d5b1c4bb471f9de53f4d5cf7cc82. Resources: {'cores', 'ram', 'instances'} {{(pid=117646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 10:36:02.172003 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-6ec0540b-1c99-42a9-a1df-7acd2d27ea5d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Going to run 1 instances... {{(pid=117646) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 10:36:02.174245 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-6ec0540b-1c99-42a9-a1df-7acd2d27ea5d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 4b00fddd-6b8f-484d-baca-59c54ff53aa3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c96509d-f65f-42b0-94b3-6fc590a93508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 10:36:02.219857 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-6ec0540b-1c99-42a9-a1df-7acd2d27ea5d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.556805 Jul 07 10:36:02.220513 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 485/952] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jul 7 10:36:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 10:36:02.231037 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2ae666bb-8d55-440a-a25e-5f57520d018a tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:02.231652 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-2ae666bb-8d55-440a-a25e-5f57520d018a tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 4b00fddd-6b8f-484d-baca-59c54ff53aa3] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:02.285650 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-2ae666bb-8d55-440a-a25e-5f57520d018a tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:36:02.292768 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-2ae666bb-8d55-440a-a25e-5f57520d018a tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3" status: 200 len: 1242 microversion: 2.1 time: 0.065662 Jul 07 10:36:02.293340 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 468/953] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:36:02 2022] GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3 => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:36:03.310005 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-796de4ec-52fe-44fd-b46c-7fc0784eb35d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:03.310627 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-796de4ec-52fe-44fd-b46c-7fc0784eb35d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 4b00fddd-6b8f-484d-baca-59c54ff53aa3] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:03.320073 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-796de4ec-52fe-44fd-b46c-7fc0784eb35d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:03.320534 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-796de4ec-52fe-44fd-b46c-7fc0784eb35d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:03.321316 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-796de4ec-52fe-44fd-b46c-7fc0784eb35d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:03.321763 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-796de4ec-52fe-44fd-b46c-7fc0784eb35d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:03.384800 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-796de4ec-52fe-44fd-b46c-7fc0784eb35d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:36:03.392746 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-796de4ec-52fe-44fd-b46c-7fc0784eb35d tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3" status: 200 len: 1300 microversion: 2.1 time: 0.087220 Jul 07 10:36:03.393315 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 486/954] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:36:03 2022] GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3 => generated 1300 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:36:04.409775 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4f12983b-1697-4365-9fd3-ba32469e71de tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:04.410395 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-4f12983b-1697-4365-9fd3-ba32469e71de tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 4b00fddd-6b8f-484d-baca-59c54ff53aa3] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:04.418676 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4f12983b-1697-4365-9fd3-ba32469e71de tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:04.419138 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4f12983b-1697-4365-9fd3-ba32469e71de tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:04.419940 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4f12983b-1697-4365-9fd3-ba32469e71de tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:04.420382 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4f12983b-1697-4365-9fd3-ba32469e71de tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:04.448308 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-2a5988c8-f8e7-446d-8fab-94b20963884d req-b6c55cd0-127b-4477-99b9-6ffb9a352f0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b00fddd-6b8f-484d-baca-59c54ff53aa3", "tag": "2f90a7b1-2d24-4e33-97da-f26156c08547"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:36:04.465277 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-2a5988c8-f8e7-446d-8fab-94b20963884d req-b6c55cd0-127b-4477-99b9-6ffb9a352f0f service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:04.465845 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-2a5988c8-f8e7-446d-8fab-94b20963884d req-b6c55cd0-127b-4477-99b9-6ffb9a352f0f service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:04.480804 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-2a5988c8-f8e7-446d-8fab-94b20963884d req-b6c55cd0-127b-4477-99b9-6ffb9a352f0f service nova] Creating event network-changed:2f90a7b1-2d24-4e33-97da-f26156c08547 for instance 4b00fddd-6b8f-484d-baca-59c54ff53aa3 on hv-cinder-82282 Jul 07 10:36:04.486504 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-2a5988c8-f8e7-446d-8fab-94b20963884d req-b6c55cd0-127b-4477-99b9-6ffb9a352f0f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041642 Jul 07 10:36:04.488032 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 487/955] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:36:04.618822 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-4f12983b-1697-4365-9fd3-ba32469e71de tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:36:04.627258 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-4f12983b-1697-4365-9fd3-ba32469e71de tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3" status: 200 len: 1367 microversion: 2.1 time: 0.221332 Jul 07 10:36:04.628019 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 469/956] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:36:04 2022] GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:36:05.647185 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-1e55f5b6-b741-43b7-a468-ce941e3c2ab3 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:05.647923 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-1e55f5b6-b741-43b7-a468-ce941e3c2ab3 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 4b00fddd-6b8f-484d-baca-59c54ff53aa3] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:05.654118 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1e55f5b6-b741-43b7-a468-ce941e3c2ab3 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:05.654574 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1e55f5b6-b741-43b7-a468-ce941e3c2ab3 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:05.655334 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1e55f5b6-b741-43b7-a468-ce941e3c2ab3 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:05.655796 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1e55f5b6-b741-43b7-a468-ce941e3c2ab3 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:05.780197 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-1e55f5b6-b741-43b7-a468-ce941e3c2ab3 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:36:05.787472 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-1e55f5b6-b741-43b7-a468-ce941e3c2ab3 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3" status: 200 len: 1367 microversion: 2.1 time: 0.145619 Jul 07 10:36:05.788059 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 488/957] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:36:05 2022] GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:36:06.804309 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-01d769b2-bc21-42a5-9928-61ad29d177c5 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:06.804833 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-01d769b2-bc21-42a5-9928-61ad29d177c5 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 4b00fddd-6b8f-484d-baca-59c54ff53aa3] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:06.811385 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-01d769b2-bc21-42a5-9928-61ad29d177c5 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:06.811868 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-01d769b2-bc21-42a5-9928-61ad29d177c5 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:06.812638 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-01d769b2-bc21-42a5-9928-61ad29d177c5 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:06.813091 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-01d769b2-bc21-42a5-9928-61ad29d177c5 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:06.943477 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-01d769b2-bc21-42a5-9928-61ad29d177c5 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:36:06.950868 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-01d769b2-bc21-42a5-9928-61ad29d177c5 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3" status: 200 len: 1367 microversion: 2.1 time: 0.150524 Jul 07 10:36:06.951426 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 470/958] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:36:06 2022] GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:36:07.968071 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-de1540e0-0aae-413c-8dd7-6c0b2db31e99 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:07.968708 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-de1540e0-0aae-413c-8dd7-6c0b2db31e99 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 4b00fddd-6b8f-484d-baca-59c54ff53aa3] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:07.971119 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:36:07.976760 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-de1540e0-0aae-413c-8dd7-6c0b2db31e99 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:07.977206 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-de1540e0-0aae-413c-8dd7-6c0b2db31e99 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:07.977959 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-de1540e0-0aae-413c-8dd7-6c0b2db31e99 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:07.978394 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-de1540e0-0aae-413c-8dd7-6c0b2db31e99 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:08.107818 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-de1540e0-0aae-413c-8dd7-6c0b2db31e99 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:36:08.115947 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-de1540e0-0aae-413c-8dd7-6c0b2db31e99 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3" status: 200 len: 1367 microversion: 2.1 time: 0.151692 Jul 07 10:36:08.116508 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 489/959] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:36:07 2022] GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:36:09.133388 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d9240231-6f06-47ed-8578-cd511b833803 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:09.133905 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d9240231-6f06-47ed-8578-cd511b833803 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 4b00fddd-6b8f-484d-baca-59c54ff53aa3] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:09.140394 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d9240231-6f06-47ed-8578-cd511b833803 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:09.140845 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d9240231-6f06-47ed-8578-cd511b833803 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:09.141625 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d9240231-6f06-47ed-8578-cd511b833803 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:09.142058 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d9240231-6f06-47ed-8578-cd511b833803 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:09.266726 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d9240231-6f06-47ed-8578-cd511b833803 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:36:09.274071 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d9240231-6f06-47ed-8578-cd511b833803 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3" status: 200 len: 1367 microversion: 2.1 time: 0.145232 Jul 07 10:36:09.274634 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 471/960] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:36:09 2022] GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:36:10.284478 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-1a3731f6-de04-4381-addd-74f6e0a79e64 req-76121b2f-4693-4409-97bd-362b8354e3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b00fddd-6b8f-484d-baca-59c54ff53aa3", "name": "network-vif-plugged", "status": "completed", "tag": "2f90a7b1-2d24-4e33-97da-f26156c08547"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:36:10.291198 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5d4343e6-4ae2-44b2-b507-cf087e427a49 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:10.291929 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5d4343e6-4ae2-44b2-b507-cf087e427a49 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 4b00fddd-6b8f-484d-baca-59c54ff53aa3] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:10.294546 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:36:10.297450 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-1a3731f6-de04-4381-addd-74f6e0a79e64 req-76121b2f-4693-4409-97bd-362b8354e3d2 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:10.297928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-1a3731f6-de04-4381-addd-74f6e0a79e64 req-76121b2f-4693-4409-97bd-362b8354e3d2 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:10.300685 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5d4343e6-4ae2-44b2-b507-cf087e427a49 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:10.301148 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5d4343e6-4ae2-44b2-b507-cf087e427a49 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:10.301959 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5d4343e6-4ae2-44b2-b507-cf087e427a49 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:10.302580 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5d4343e6-4ae2-44b2-b507-cf087e427a49 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:10.311546 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-1a3731f6-de04-4381-addd-74f6e0a79e64 req-76121b2f-4693-4409-97bd-362b8354e3d2 service nova] Creating event network-vif-plugged:2f90a7b1-2d24-4e33-97da-f26156c08547 for instance 4b00fddd-6b8f-484d-baca-59c54ff53aa3 on hv-cinder-82282 Jul 07 10:36:10.317926 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-1a3731f6-de04-4381-addd-74f6e0a79e64 req-76121b2f-4693-4409-97bd-362b8354e3d2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036488 Jul 07 10:36:10.318830 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 490/961] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:36:10.443577 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5d4343e6-4ae2-44b2-b507-cf087e427a49 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:36:10.452229 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5d4343e6-4ae2-44b2-b507-cf087e427a49 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3" status: 200 len: 1367 microversion: 2.1 time: 0.165218 Jul 07 10:36:10.452788 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 472/962] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:36:10 2022] GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:36:11.469672 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-6aabbe47-49c9-41f0-96fd-d99fd9652310 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:11.470363 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-6aabbe47-49c9-41f0-96fd-d99fd9652310 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 4b00fddd-6b8f-484d-baca-59c54ff53aa3] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:11.477664 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6aabbe47-49c9-41f0-96fd-d99fd9652310 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:11.478119 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6aabbe47-49c9-41f0-96fd-d99fd9652310 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:11.478885 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6aabbe47-49c9-41f0-96fd-d99fd9652310 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:11.479323 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6aabbe47-49c9-41f0-96fd-d99fd9652310 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:11.607142 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-6aabbe47-49c9-41f0-96fd-d99fd9652310 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:36:11.614832 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-6aabbe47-49c9-41f0-96fd-d99fd9652310 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3" status: 200 len: 1367 microversion: 2.1 time: 0.149343 Jul 07 10:36:11.615532 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 491/963] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:36:11 2022] GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:36:12.631576 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-be4b557e-2b73-45ee-a5a6-93845bbbf362 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:12.632219 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-be4b557e-2b73-45ee-a5a6-93845bbbf362 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 4b00fddd-6b8f-484d-baca-59c54ff53aa3] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:12.634583 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=6 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:36:12.640280 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-be4b557e-2b73-45ee-a5a6-93845bbbf362 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:12.640729 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-be4b557e-2b73-45ee-a5a6-93845bbbf362 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:12.641487 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-be4b557e-2b73-45ee-a5a6-93845bbbf362 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:12.641919 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-be4b557e-2b73-45ee-a5a6-93845bbbf362 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:12.768874 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-be4b557e-2b73-45ee-a5a6-93845bbbf362 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:36:12.776781 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-be4b557e-2b73-45ee-a5a6-93845bbbf362 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3" status: 200 len: 1557 microversion: 2.1 time: 0.149087 Jul 07 10:36:12.777344 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 473/964] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:36:12 2022] GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:36:12.793183 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-1d6f9105-9558-4040-ad8d-051b1b5efa3b tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:12.793682 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-1d6f9105-9558-4040-ad8d-051b1b5efa3b tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 4b00fddd-6b8f-484d-baca-59c54ff53aa3] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:12.795605 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell0:SELECT=2 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:36:12.796312 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell0:SELECT=6 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:36:12.802602 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1d6f9105-9558-4040-ad8d-051b1b5efa3b tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:12.803085 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1d6f9105-9558-4040-ad8d-051b1b5efa3b tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:12.803877 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1d6f9105-9558-4040-ad8d-051b1b5efa3b tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:12.804320 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-1d6f9105-9558-4040-ad8d-051b1b5efa3b tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:12.878522 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-1d6f9105-9558-4040-ad8d-051b1b5efa3b tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089119 Jul 07 10:36:12.879115 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 492/965] 10.222.0.16 () {58 vars in 1274 bytes} [Thu Jul 7 10:36:12 2022] GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:36:13.779296 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-35ffba74-880d-44b1-ba7f-993a2e878e6a req-267af5b5-cb90-468b-a091-8cd4fcd30cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b00fddd-6b8f-484d-baca-59c54ff53aa3", "tag": "2f90a7b1-2d24-4e33-97da-f26156c08547"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:36:13.788467 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-35ffba74-880d-44b1-ba7f-993a2e878e6a req-267af5b5-cb90-468b-a091-8cd4fcd30cc4 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:13.788911 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-35ffba74-880d-44b1-ba7f-993a2e878e6a req-267af5b5-cb90-468b-a091-8cd4fcd30cc4 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:13.799581 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-35ffba74-880d-44b1-ba7f-993a2e878e6a req-267af5b5-cb90-468b-a091-8cd4fcd30cc4 service nova] Creating event network-changed:2f90a7b1-2d24-4e33-97da-f26156c08547 for instance 4b00fddd-6b8f-484d-baca-59c54ff53aa3 on hv-cinder-82282 Jul 07 10:36:13.805253 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-35ffba74-880d-44b1-ba7f-993a2e878e6a req-267af5b5-cb90-468b-a091-8cd4fcd30cc4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029650 Jul 07 10:36:13.805891 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 474/966] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:36:32.808851 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_api:SELECT=7 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:36:32.809791 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:36:32.814266 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-8945fa1b-762c-43d7-b7b8-f2631b906699 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:32.815281 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-8945fa1b-762c-43d7-b7b8-f2631b906699 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:32.823512 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8945fa1b-762c-43d7-b7b8-f2631b906699 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:32.823999 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8945fa1b-762c-43d7-b7b8-f2631b906699 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:32.824766 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8945fa1b-762c-43d7-b7b8-f2631b906699 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:32.825205 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-8945fa1b-762c-43d7-b7b8-f2631b906699 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:32.853275 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-8945fa1b-762c-43d7-b7b8-f2631b906699 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045769 Jul 07 10:36:32.853843 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 493/967] 10.222.0.16 () {60 vars in 1342 bytes} [Thu Jul 7 10:36:32 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:36:32.907798 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=5 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:36:32.908557 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=53 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:36:32.912900 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-55a48293-d717-4ed9-a8c4-56fa264331b2 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:32.913495 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-55a48293-d717-4ed9-a8c4-56fa264331b2 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:32.920314 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-55a48293-d717-4ed9-a8c4-56fa264331b2 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:32.920763 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-55a48293-d717-4ed9-a8c4-56fa264331b2 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:32.921574 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-55a48293-d717-4ed9-a8c4-56fa264331b2 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:32.922009 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-55a48293-d717-4ed9-a8c4-56fa264331b2 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:32.947206 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-55a48293-d717-4ed9-a8c4-56fa264331b2 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Going to try to terminate instance {{(pid=117647) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 10:36:33.022525 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-55a48293-d717-4ed9-a8c4-56fa264331b2 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 204 len: 0 microversion: 2.20 time: 0.116059 Jul 07 10:36:33.023123 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 475/968] 10.222.0.16 () {60 vars in 1279 bytes} [Thu Jul 7 10:36:32 2022] DELETE /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 07 10:36:33.031662 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-4e666749-8acd-40f4-9bd7-c75c6e0cdfad tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:33.032232 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-4e666749-8acd-40f4-9bd7-c75c6e0cdfad tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:33.038137 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4e666749-8acd-40f4-9bd7-c75c6e0cdfad tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:33.038592 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4e666749-8acd-40f4-9bd7-c75c6e0cdfad tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:33.039351 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4e666749-8acd-40f4-9bd7-c75c6e0cdfad tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:33.039818 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-4e666749-8acd-40f4-9bd7-c75c6e0cdfad tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:33.171384 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-4e666749-8acd-40f4-9bd7-c75c6e0cdfad tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:36:33.179774 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-4e666749-8acd-40f4-9bd7-c75c6e0cdfad tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:36:33.181278 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-4e666749-8acd-40f4-9bd7-c75c6e0cdfad tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:36:33.182433 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-4e666749-8acd-40f4-9bd7-c75c6e0cdfad tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1722 microversion: 2.20 time: 0.154874 Jul 07 10:36:33.186608 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 494/969] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:36:33 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:36:34.202038 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-44d31700-2913-4734-b902-fe93366aaafe tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:34.202742 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-44d31700-2913-4734-b902-fe93366aaafe tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:34.209184 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-44d31700-2913-4734-b902-fe93366aaafe tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:34.209666 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-44d31700-2913-4734-b902-fe93366aaafe tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:34.210432 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-44d31700-2913-4734-b902-fe93366aaafe tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:34.210869 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-44d31700-2913-4734-b902-fe93366aaafe tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:34.349826 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-44d31700-2913-4734-b902-fe93366aaafe tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:36:34.358678 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-44d31700-2913-4734-b902-fe93366aaafe tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:36:34.360499 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-44d31700-2913-4734-b902-fe93366aaafe tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:36:34.361686 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-44d31700-2913-4734-b902-fe93366aaafe tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1722 microversion: 2.20 time: 0.164009 Jul 07 10:36:34.362253 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 476/970] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:36:34 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:36:34.966050 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a28a6bd4-1978-4bb9-bb16-7ba85c3405ab tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:34.966632 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-a28a6bd4-1978-4bb9-bb16-7ba85c3405ab tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 508054db-8968-4f14-ad81-973a970d7039] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:34.971992 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-37206a89-6cf8-483b-ab0e-1836ff885ee6 req-bc1ab155-1018-4d5a-b97d-8ad74048281b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "508054db-8968-4f14-ad81-973a970d7039", "tag": "4c958c7f-c732-46dd-ab0f-9c7fb9c56d25"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:36:34.984418 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-37206a89-6cf8-483b-ab0e-1836ff885ee6 req-bc1ab155-1018-4d5a-b97d-8ad74048281b service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:34.984874 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-37206a89-6cf8-483b-ab0e-1836ff885ee6 req-bc1ab155-1018-4d5a-b97d-8ad74048281b service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:34.989588 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a28a6bd4-1978-4bb9-bb16-7ba85c3405ab tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:34.990053 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a28a6bd4-1978-4bb9-bb16-7ba85c3405ab tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:34.990844 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a28a6bd4-1978-4bb9-bb16-7ba85c3405ab tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:34.991429 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-a28a6bd4-1978-4bb9-bb16-7ba85c3405ab tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:35.016427 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-37206a89-6cf8-483b-ab0e-1836ff885ee6 req-bc1ab155-1018-4d5a-b97d-8ad74048281b service nova] Creating event network-changed:4c958c7f-c732-46dd-ab0f-9c7fb9c56d25 for instance 508054db-8968-4f14-ad81-973a970d7039 on hv-cinder-82282 Jul 07 10:36:35.026856 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-37206a89-6cf8-483b-ab0e-1836ff885ee6 req-bc1ab155-1018-4d5a-b97d-8ad74048281b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056082 Jul 07 10:36:35.029711 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 477/971] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 10:36:35.041577 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-a28a6bd4-1978-4bb9-bb16-7ba85c3405ab tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 508054db-8968-4f14-ad81-973a970d7039] Going to try to terminate instance {{(pid=117646) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 10:36:35.162528 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-a28a6bd4-1978-4bb9-bb16-7ba85c3405ab tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "DELETE /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039" status: 204 len: 0 microversion: 2.1 time: 0.200013 Jul 07 10:36:35.164200 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 495/972] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jul 7 10:36:34 2022] DELETE /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 10:36:35.171867 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-fa08edf6-2282-4ab4-8d84-80da98a16761 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:35.173105 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-fa08edf6-2282-4ab4-8d84-80da98a16761 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 508054db-8968-4f14-ad81-973a970d7039] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:35.180212 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fa08edf6-2282-4ab4-8d84-80da98a16761 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:35.180727 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fa08edf6-2282-4ab4-8d84-80da98a16761 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:35.181517 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fa08edf6-2282-4ab4-8d84-80da98a16761 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:35.181963 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fa08edf6-2282-4ab4-8d84-80da98a16761 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:35.381966 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-ddaae65d-9897-47b4-b155-07fbf264263e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:35.382733 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-ddaae65d-9897-47b4-b155-07fbf264263e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:35.389293 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ddaae65d-9897-47b4-b155-07fbf264263e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:35.389293 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ddaae65d-9897-47b4-b155-07fbf264263e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:35.389890 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ddaae65d-9897-47b4-b155-07fbf264263e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:35.390337 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-ddaae65d-9897-47b4-b155-07fbf264263e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:35.408332 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-fa08edf6-2282-4ab4-8d84-80da98a16761 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:36:35.423567 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-fa08edf6-2282-4ab4-8d84-80da98a16761 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039" status: 200 len: 1576 microversion: 2.1 time: 0.254128 Jul 07 10:36:35.424069 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 478/973] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:36:35 2022] GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039 => generated 1576 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 10:36:35.454916 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-ddaae65d-9897-47b4-b155-07fbf264263e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:36:35.463675 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-ddaae65d-9897-47b4-b155-07fbf264263e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:36:35.465223 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-ddaae65d-9897-47b4-b155-07fbf264263e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:36:35.466393 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-ddaae65d-9897-47b4-b155-07fbf264263e tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1655 microversion: 2.20 time: 0.089351 Jul 07 10:36:35.466962 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 496/974] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:36:35 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1655 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 10:36:35.619816 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-012ee0c5-8c30-49ae-b8b2-f98d7b4e9b9d req-9113af99-26f5-478d-81e7-57c02a93a999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e66414c-2b54-4dcf-822c-96e90792fac7", "name": "network-vif-deleted", "tag": "c7f05a17-2bf9-4c26-b60c-bf7c44c7df40"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:36:35.635219 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-012ee0c5-8c30-49ae-b8b2-f98d7b4e9b9d req-9113af99-26f5-478d-81e7-57c02a93a999 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:35.635850 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-012ee0c5-8c30-49ae-b8b2-f98d7b4e9b9d req-9113af99-26f5-478d-81e7-57c02a93a999 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:35.648394 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-012ee0c5-8c30-49ae-b8b2-f98d7b4e9b9d req-9113af99-26f5-478d-81e7-57c02a93a999 service nova] Creating event network-vif-deleted:c7f05a17-2bf9-4c26-b60c-bf7c44c7df40 for instance 0e66414c-2b54-4dcf-822c-96e90792fac7 on hv-cinder-82282 Jul 07 10:36:35.656107 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-012ee0c5-8c30-49ae-b8b2-f98d7b4e9b9d req-9113af99-26f5-478d-81e7-57c02a93a999 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122972 Jul 07 10:36:35.657476 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 479/975] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:36:36.442962 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-0944de1f-cd7a-4448-8ebf-ffaa7c3cf1e2 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:36.443574 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-0944de1f-cd7a-4448-8ebf-ffaa7c3cf1e2 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 508054db-8968-4f14-ad81-973a970d7039] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:36.450537 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0944de1f-cd7a-4448-8ebf-ffaa7c3cf1e2 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:36.451088 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0944de1f-cd7a-4448-8ebf-ffaa7c3cf1e2 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:36.451968 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0944de1f-cd7a-4448-8ebf-ffaa7c3cf1e2 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:36.452639 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-0944de1f-cd7a-4448-8ebf-ffaa7c3cf1e2 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:36.485500 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b5d8dfc5-6ab0-4688-85f5-a3fd2e11d283 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:36.486197 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b5d8dfc5-6ab0-4688-85f5-a3fd2e11d283 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:36.493596 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b5d8dfc5-6ab0-4688-85f5-a3fd2e11d283 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:36.494041 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b5d8dfc5-6ab0-4688-85f5-a3fd2e11d283 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:36.495084 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b5d8dfc5-6ab0-4688-85f5-a3fd2e11d283 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:36.495519 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b5d8dfc5-6ab0-4688-85f5-a3fd2e11d283 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:36.539488 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b5d8dfc5-6ab0-4688-85f5-a3fd2e11d283 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:36.540223 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b5d8dfc5-6ab0-4688-85f5-a3fd2e11d283 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:36.540909 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.objects.instance [None req-b5d8dfc5-6ab0-4688-85f5-a3fd2e11d283 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lazy-loading 'fault' on Instance uuid 0e66414c-2b54-4dcf-822c-96e90792fac7 {{(pid=117647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 10:36:36.616450 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b5d8dfc5-6ab0-4688-85f5-a3fd2e11d283 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:36:36.617101 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-0944de1f-cd7a-4448-8ebf-ffaa7c3cf1e2 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:36:36.625049 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-0944de1f-cd7a-4448-8ebf-ffaa7c3cf1e2 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039" status: 200 len: 1576 microversion: 2.1 time: 0.186867 Jul 07 10:36:36.627705 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b5d8dfc5-6ab0-4688-85f5-a3fd2e11d283 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:36:36.629467 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b5d8dfc5-6ab0-4688-85f5-a3fd2e11d283 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31bcb5c27d8b4ae2b9a3207fff0eabfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96923df6a03841498e3732c8504b6363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:36:36.631281 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b5d8dfc5-6ab0-4688-85f5-a3fd2e11d283 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 200 len: 1372 microversion: 2.20 time: 0.150122 Jul 07 10:36:36.632229 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 480/976] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:36:36 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 10:36:36.636081 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 497/977] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:36:36 2022] GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039 => generated 1576 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:36:37.642490 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-876f0c8d-07bc-4243-b776-c206a1d50f1d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:37.643107 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-876f0c8d-07bc-4243-b776-c206a1d50f1d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 508054db-8968-4f14-ad81-973a970d7039] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:37.650754 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-3472d116-a9ad-40a0-8204-48f28a9b4017 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:37.651367 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-876f0c8d-07bc-4243-b776-c206a1d50f1d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:37.651367 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-876f0c8d-07bc-4243-b776-c206a1d50f1d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:37.652046 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-876f0c8d-07bc-4243-b776-c206a1d50f1d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:37.652279 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-3472d116-a9ad-40a0-8204-48f28a9b4017 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:37.652566 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-876f0c8d-07bc-4243-b776-c206a1d50f1d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:37.659431 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3472d116-a9ad-40a0-8204-48f28a9b4017 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:37.659927 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3472d116-a9ad-40a0-8204-48f28a9b4017 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:37.660920 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3472d116-a9ad-40a0-8204-48f28a9b4017 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:37.661359 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3472d116-a9ad-40a0-8204-48f28a9b4017 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:37.677699 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.wsgi [None req-3472d116-a9ad-40a0-8204-48f28a9b4017 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] HTTP exception thrown: Instance 0e66414c-2b54-4dcf-822c-96e90792fac7 could not be found. Jul 07 10:36:37.679669 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-3472d116-a9ad-40a0-8204-48f28a9b4017 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Request method failure captured: Jul 07 10:36:37.679669 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 HTTP/1.1 Jul 07 10:36:37.679669 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:36:37.679669 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:36:37.679669 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:36:37.679669 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 0 Jul 07 10:36:37.679669 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:36:37.679669 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:36:37.679669 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:36:37.679669 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:36:37.679669 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrYEuYwKPnkljHRk0_LP-3RppqXYxDJn2lNWAJneOsf-lRx6WT0_NrypbEEQSItWaO3W8cpEmzNT5WjpjEAPB0TQbNcPkt25V_LEh4yiglMFXVSxfL_2uZcHY4WokoEvFeWe4OUptx5h-iDEfigAwq3jSzFUZu6eeEoLElUei2R-6iQ Jul 07 10:36:37.679669 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:36:37.679669 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:36:37.679669 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:36:37.679669 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:36:37.679669 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Openstack-Nova-Api-Version: 2.20 Jul 07 10:36:37.679669 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:36:37.679669 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:36:37.679669 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: 96923df6a03841498e3732c8504b6363 Jul 07 10:36:37.679669 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1231301553 Jul 07 10:36:37.679669 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:36:37.679669 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:36:37.681295 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96923df6a03841498e3732c8504b6363"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96923df6a03841498e3732c8504b6363"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96923df6a03841498e3732c8504b6363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96923df6a03841498e3732c8504b6363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:36:37.681295 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1231301553 Jul 07 10:36:37.681295 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: 96923df6a03841498e3732c8504b6363 Jul 07 10:36:37.681295 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1231301553 Jul 07 10:36:37.681295 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-AttachVolumeShelveTestJSON-1231301553-project Jul 07 10:36:37.681295 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:36:37.681295 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:36:37.681295 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: 31bcb5c27d8b4ae2b9a3207fff0eabfe Jul 07 10:36:37.681295 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1231301553-project Jul 07 10:36:37.681295 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: > Jul 07 10:36:37.681295 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Instance 0e66414c-2b54-4dcf-822c-96e90792fac7 could not be found. Jul 07 10:36:37.681295 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'id': '0e66414c-2b54-4dcf-822c-96e90792fac7'} Jul 07 10:36:37.682268 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:36:37.682268 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:36:37.682268 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:36:37.682268 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:36:37.682268 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:36:37.682268 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:36:37.682268 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:36:37.682268 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:36:37.682268 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:36:37.682268 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:36:37.682268 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e66414c-2b54-4dcf-822c-96e90792fac7 could not be found. Jul 07 10:36:37.682268 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:36:37.682268 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:36:37.682268 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:36:37.682268 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:36:37.682268 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:36:37.682268 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:36:37.682268 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:36:37.682268 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:36:37.682268 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:36:37.683806 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:36:37.683806 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:36:37.683806 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:36:37.683806 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:36:37.683806 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:36:37.683806 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:36:37.683806 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:36:37.683806 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e66414c-2b54-4dcf-822c-96e90792fac7 could not be found. Jul 07 10:36:37.683806 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:36:37.683806 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:36:37.683806 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:36:37.683806 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:36:37.683806 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:36:37.683806 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:36:37.683806 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:36:37.683806 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:36:37.683806 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e66414c-2b54-4dcf-822c-96e90792fac7 could not be found. Jul 07 10:36:37.683806 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:36:37.685157 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-3472d116-a9ad-40a0-8204-48f28a9b4017 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Returning 404 to user: Instance 0e66414c-2b54-4dcf-822c-96e90792fac7 could not be found. {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:36:37.685157 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-3472d116-a9ad-40a0-8204-48f28a9b4017 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 404 len: 111 microversion: 2.20 time: 0.034865 Jul 07 10:36:37.685519 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 498/978] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:36:37 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 07 10:36:37.690382 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-ab188472-bddf-460f-be27-c22ef37ff6cb tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '.version_select at 0x7f9e9e365040>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:37.710090 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-ab188472-bddf-460f-be27-c22ef37ff6cb tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1120094088" status: 204 len: 0 microversion: 2.20 time: 0.023463 Jul 07 10:36:37.710931 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 499/979] 10.222.0.16 () {60 vars in 1261 bytes} [Thu Jul 7 10:36:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1120094088 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 07 10:36:37.715342 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-18a8803b-a928-4358-a760-135bf5708e9c req-c0b7fe43-698e-4bf3-b0a1-e6e65a195606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "508054db-8968-4f14-ad81-973a970d7039", "name": "network-vif-deleted", "tag": "4c958c7f-c732-46dd-ab0f-9c7fb9c56d25"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:36:37.724115 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-18a8803b-a928-4358-a760-135bf5708e9c req-c0b7fe43-698e-4bf3-b0a1-e6e65a195606 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:37.724563 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-18a8803b-a928-4358-a760-135bf5708e9c req-c0b7fe43-698e-4bf3-b0a1-e6e65a195606 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:37.731331 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-876f0c8d-07bc-4243-b776-c206a1d50f1d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:36:37.735733 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-18a8803b-a928-4358-a760-135bf5708e9c req-c0b7fe43-698e-4bf3-b0a1-e6e65a195606 service nova] Creating event network-vif-deleted:4c958c7f-c732-46dd-ab0f-9c7fb9c56d25 for instance 508054db-8968-4f14-ad81-973a970d7039 on hv-cinder-82282 Jul 07 10:36:37.739880 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-876f0c8d-07bc-4243-b776-c206a1d50f1d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039" status: 200 len: 1392 microversion: 2.1 time: 0.101266 Jul 07 10:36:37.740461 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 481/980] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:36:37 2022] GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039 => generated 1392 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:36:37.741066 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-18a8803b-a928-4358-a760-135bf5708e9c req-c0b7fe43-698e-4bf3-b0a1-e6e65a195606 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029096 Jul 07 10:36:37.741660 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 500/981] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:36:38.758354 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b77af376-cc69-476b-8c92-28d917c27294 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:38.758895 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b77af376-cc69-476b-8c92-28d917c27294 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 508054db-8968-4f14-ad81-973a970d7039] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:38.765540 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b77af376-cc69-476b-8c92-28d917c27294 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:38.765997 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b77af376-cc69-476b-8c92-28d917c27294 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:38.766758 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b77af376-cc69-476b-8c92-28d917c27294 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:38.767200 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b77af376-cc69-476b-8c92-28d917c27294 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:38.780075 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-b77af376-cc69-476b-8c92-28d917c27294 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] HTTP exception thrown: Instance 508054db-8968-4f14-ad81-973a970d7039 could not be found. Jul 07 10:36:38.781725 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b77af376-cc69-476b-8c92-28d917c27294 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Request method failure captured: Jul 07 10:36:38.781725 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039 HTTP/1.1 Jul 07 10:36:38.781725 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept: application/json Jul 07 10:36:38.781725 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jul 07 10:36:38.781725 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Connection: close Jul 07 10:36:38.781725 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jul 07 10:36:38.781725 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jul 07 10:36:38.781725 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Host: 10.222.0.16 Jul 07 10:36:38.781725 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jul 07 10:36:38.781725 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jul 07 10:36:38.781725 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABixrWBVteUyCqdbDELQednwVozbqX_3TVDWbVerzXdDH8pThAeXJI6Hme7Aj69Po7w29VfH5QDBIIPdKnql24pcEXNAywLc35EX6qquSHxXTCKMvhd-Hr1rdv027OK_Q4fyHYTFD6BSCksK7MQq4TvwsxbU5DcDgS6He7rtehl8aUmUjg Jul 07 10:36:38.781725 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jul 07 10:36:38.781725 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jul 07 10:36:38.781725 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jul 07 10:36:38.781725 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jul 07 10:36:38.781725 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jul 07 10:36:38.781725 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jul 07 10:36:38.781725 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Id: 12a91d56e163442dacf4c5ce7b28a132 Jul 07 10:36:38.781725 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-TestVolumeBootPattern-929143946 Jul 07 10:36:38.781725 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jul 07 10:36:38.781725 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jul 07 10:36:38.783408 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/12a91d56e163442dacf4c5ce7b28a132"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/12a91d56e163442dacf4c5ce7b28a132"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/12a91d56e163442dacf4c5ce7b28a132"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_12a91d56e163442dacf4c5ce7b28a132"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:36:38.783408 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-TestVolumeBootPattern-929143946 Jul 07 10:36:38.783408 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 12a91d56e163442dacf4c5ce7b28a132 Jul 07 10:36:38.783408 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-TestVolumeBootPattern-929143946 Jul 07 10:36:38.783408 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User: tempest-TestVolumeBootPattern-929143946-project Jul 07 10:36:38.783408 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jul 07 10:36:38.783408 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jul 07 10:36:38.783408 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Id: 059a87a80fc547db8aeb3bb03003cd2c Jul 07 10:36:38.783408 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-TestVolumeBootPattern-929143946-project Jul 07 10:36:38.783408 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: method: > Jul 07 10:36:38.783408 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: exception: Instance 508054db-8968-4f14-ad81-973a970d7039 could not be found. Jul 07 10:36:38.783408 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: action_args: {'id': '508054db-8968-4f14-ad81-973a970d7039'} Jul 07 10:36:38.784284 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:36:38.784284 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:36:38.784284 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:36:38.784284 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:36:38.784284 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:36:38.784284 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:36:38.784284 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:36:38.784284 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:36:38.784284 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:36:38.784284 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:36:38.784284 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 508054db-8968-4f14-ad81-973a970d7039 could not be found. Jul 07 10:36:38.784284 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:36:38.784284 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:36:38.784284 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:36:38.784284 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:36:38.784284 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:36:38.784284 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:36:38.784284 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:36:38.784284 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:36:38.784284 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:36:38.785523 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:36:38.785523 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:36:38.785523 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:36:38.785523 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:36:38.785523 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:36:38.785523 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:36:38.785523 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:36:38.785523 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 508054db-8968-4f14-ad81-973a970d7039 could not be found. Jul 07 10:36:38.785523 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:36:38.785523 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:36:38.785523 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:36:38.785523 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:36:38.785523 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:36:38.785523 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:36:38.785523 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:36:38.785523 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:36:38.785523 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 508054db-8968-4f14-ad81-973a970d7039 could not be found. Jul 07 10:36:38.785523 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:36:38.786681 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b77af376-cc69-476b-8c92-28d917c27294 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Returning 404 to user: Instance 508054db-8968-4f14-ad81-973a970d7039 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:36:38.786681 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b77af376-cc69-476b-8c92-28d917c27294 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039" status: 404 len: 111 microversion: 2.1 time: 0.029428 Jul 07 10:36:38.786681 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 482/982] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:36:38 2022] GET /compute/v2.1/servers/508054db-8968-4f14-ad81-973a970d7039 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:36:39.488002 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-59e10dbd-756d-4fc9-b23e-7c8ebcf9302c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:39.488539 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-59e10dbd-756d-4fc9-b23e-7c8ebcf9302c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:39.495496 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-59e10dbd-756d-4fc9-b23e-7c8ebcf9302c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:39.495987 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-59e10dbd-756d-4fc9-b23e-7c8ebcf9302c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:39.496756 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-59e10dbd-756d-4fc9-b23e-7c8ebcf9302c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:39.497198 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-59e10dbd-756d-4fc9-b23e-7c8ebcf9302c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:39.510919 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.wsgi [None req-59e10dbd-756d-4fc9-b23e-7c8ebcf9302c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] HTTP exception thrown: Instance 0e66414c-2b54-4dcf-822c-96e90792fac7 could not be found. Jul 07 10:36:39.512617 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-59e10dbd-756d-4fc9-b23e-7c8ebcf9302c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Request method failure captured: Jul 07 10:36:39.512617 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: DELETE /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 HTTP/1.1 Jul 07 10:36:39.512617 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:36:39.512617 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:36:39.512617 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:36:39.512617 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 0 Jul 07 10:36:39.512617 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:36:39.512617 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:36:39.512617 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:36:39.512617 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:36:39.512617 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrYEuYwKPnkljHRk0_LP-3RppqXYxDJn2lNWAJneOsf-lRx6WT0_NrypbEEQSItWaO3W8cpEmzNT5WjpjEAPB0TQbNcPkt25V_LEh4yiglMFXVSxfL_2uZcHY4WokoEvFeWe4OUptx5h-iDEfigAwq3jSzFUZu6eeEoLElUei2R-6iQ Jul 07 10:36:39.512617 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:36:39.512617 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:36:39.512617 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:36:39.512617 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:36:39.512617 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Openstack-Nova-Api-Version: 2.20 Jul 07 10:36:39.512617 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:36:39.512617 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:36:39.512617 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: 96923df6a03841498e3732c8504b6363 Jul 07 10:36:39.512617 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1231301553 Jul 07 10:36:39.512617 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:36:39.512617 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:36:39.514372 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96923df6a03841498e3732c8504b6363"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96923df6a03841498e3732c8504b6363"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96923df6a03841498e3732c8504b6363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96923df6a03841498e3732c8504b6363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:36:39.514372 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1231301553 Jul 07 10:36:39.514372 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: 96923df6a03841498e3732c8504b6363 Jul 07 10:36:39.514372 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1231301553 Jul 07 10:36:39.514372 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-AttachVolumeShelveTestJSON-1231301553-project Jul 07 10:36:39.514372 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:36:39.514372 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:36:39.514372 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: 31bcb5c27d8b4ae2b9a3207fff0eabfe Jul 07 10:36:39.514372 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1231301553-project Jul 07 10:36:39.514372 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: > Jul 07 10:36:39.514372 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Instance 0e66414c-2b54-4dcf-822c-96e90792fac7 could not be found. Jul 07 10:36:39.514372 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'id': '0e66414c-2b54-4dcf-822c-96e90792fac7'} Jul 07 10:36:39.515243 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:36:39.515243 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:36:39.515243 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:36:39.515243 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:36:39.515243 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:36:39.515243 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:36:39.515243 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:36:39.515243 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:36:39.515243 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:36:39.515243 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:36:39.515243 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e66414c-2b54-4dcf-822c-96e90792fac7 could not be found. Jul 07 10:36:39.515243 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:36:39.515243 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:36:39.515243 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:36:39.515243 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:36:39.515243 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:36:39.515243 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:36:39.515243 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:36:39.515243 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:36:39.515243 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:36:39.516725 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:36:39.516725 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 10:36:39.516725 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 10:36:39.516725 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 10:36:39.516725 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 10:36:39.516725 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:36:39.516725 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:36:39.516725 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:36:39.516725 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:36:39.516725 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e66414c-2b54-4dcf-822c-96e90792fac7 could not be found. Jul 07 10:36:39.516725 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:36:39.516725 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:36:39.516725 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:36:39.516725 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:36:39.516725 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:36:39.516725 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:36:39.516725 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:36:39.516725 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:36:39.516725 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e66414c-2b54-4dcf-822c-96e90792fac7 could not be found. Jul 07 10:36:39.516725 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:36:39.518258 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-59e10dbd-756d-4fc9-b23e-7c8ebcf9302c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Returning 404 to user: Instance 0e66414c-2b54-4dcf-822c-96e90792fac7 could not be found. {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:36:39.518258 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-59e10dbd-756d-4fc9-b23e-7c8ebcf9302c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 404 len: 111 microversion: 2.20 time: 0.030780 Jul 07 10:36:39.518258 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 501/983] 10.222.0.16 () {60 vars in 1279 bytes} [Thu Jul 7 10:36:39 2022] DELETE /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 07 10:36:39.524694 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c76a40cb-d63a-4889-8dce-68e8249a4adc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:39.525300 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c76a40cb-d63a-4889-8dce-68e8249a4adc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: 0e66414c-2b54-4dcf-822c-96e90792fac7] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:39.531260 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c76a40cb-d63a-4889-8dce-68e8249a4adc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:39.531708 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c76a40cb-d63a-4889-8dce-68e8249a4adc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:39.532487 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c76a40cb-d63a-4889-8dce-68e8249a4adc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:39.532921 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c76a40cb-d63a-4889-8dce-68e8249a4adc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:39.548377 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-c76a40cb-d63a-4889-8dce-68e8249a4adc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] HTTP exception thrown: Instance 0e66414c-2b54-4dcf-822c-96e90792fac7 could not be found. Jul 07 10:36:39.549878 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c76a40cb-d63a-4889-8dce-68e8249a4adc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Request method failure captured: Jul 07 10:36:39.549878 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 HTTP/1.1 Jul 07 10:36:39.549878 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept: application/json Jul 07 10:36:39.549878 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jul 07 10:36:39.549878 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Connection: close Jul 07 10:36:39.549878 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jul 07 10:36:39.549878 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jul 07 10:36:39.549878 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Host: 10.222.0.16 Jul 07 10:36:39.549878 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jul 07 10:36:39.549878 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jul 07 10:36:39.549878 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABixrYEuYwKPnkljHRk0_LP-3RppqXYxDJn2lNWAJneOsf-lRx6WT0_NrypbEEQSItWaO3W8cpEmzNT5WjpjEAPB0TQbNcPkt25V_LEh4yiglMFXVSxfL_2uZcHY4WokoEvFeWe4OUptx5h-iDEfigAwq3jSzFUZu6eeEoLElUei2R-6iQ Jul 07 10:36:39.549878 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jul 07 10:36:39.549878 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jul 07 10:36:39.549878 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jul 07 10:36:39.549878 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jul 07 10:36:39.549878 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Openstack-Nova-Api-Version: 2.20 Jul 07 10:36:39.549878 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jul 07 10:36:39.549878 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jul 07 10:36:39.549878 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Id: 96923df6a03841498e3732c8504b6363 Jul 07 10:36:39.549878 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1231301553 Jul 07 10:36:39.549878 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jul 07 10:36:39.549878 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jul 07 10:36:39.552058 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96923df6a03841498e3732c8504b6363"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96923df6a03841498e3732c8504b6363"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96923df6a03841498e3732c8504b6363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96923df6a03841498e3732c8504b6363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:36:39.552058 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1231301553 Jul 07 10:36:39.552058 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 96923df6a03841498e3732c8504b6363 Jul 07 10:36:39.552058 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1231301553 Jul 07 10:36:39.552058 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User: tempest-AttachVolumeShelveTestJSON-1231301553-project Jul 07 10:36:39.552058 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jul 07 10:36:39.552058 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jul 07 10:36:39.552058 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Id: 31bcb5c27d8b4ae2b9a3207fff0eabfe Jul 07 10:36:39.552058 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1231301553-project Jul 07 10:36:39.552058 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: method: > Jul 07 10:36:39.552058 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: exception: Instance 0e66414c-2b54-4dcf-822c-96e90792fac7 could not be found. Jul 07 10:36:39.552058 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: action_args: {'id': '0e66414c-2b54-4dcf-822c-96e90792fac7'} Jul 07 10:36:39.552957 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:36:39.552957 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:36:39.552957 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:36:39.552957 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:36:39.552957 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:36:39.552957 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:36:39.552957 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:36:39.552957 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:36:39.552957 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:36:39.552957 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:36:39.552957 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e66414c-2b54-4dcf-822c-96e90792fac7 could not be found. Jul 07 10:36:39.552957 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:36:39.552957 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:36:39.552957 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:36:39.552957 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:36:39.552957 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:36:39.552957 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:36:39.552957 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:36:39.552957 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:36:39.552957 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:36:39.554604 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:36:39.554604 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:36:39.554604 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:36:39.554604 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:36:39.554604 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:36:39.554604 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:36:39.554604 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:36:39.554604 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e66414c-2b54-4dcf-822c-96e90792fac7 could not be found. Jul 07 10:36:39.554604 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:36:39.554604 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:36:39.554604 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:36:39.554604 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:36:39.554604 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:36:39.554604 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:36:39.554604 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:36:39.554604 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:36:39.554604 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e66414c-2b54-4dcf-822c-96e90792fac7 could not be found. Jul 07 10:36:39.554604 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:36:39.556055 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c76a40cb-d63a-4889-8dce-68e8249a4adc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Returning 404 to user: Instance 0e66414c-2b54-4dcf-822c-96e90792fac7 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:36:39.556055 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c76a40cb-d63a-4889-8dce-68e8249a4adc tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7" status: 404 len: 111 microversion: 2.20 time: 0.030450 Jul 07 10:36:39.556055 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 483/984] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:36:39 2022] GET /compute/v2.1/servers/0e66414c-2b54-4dcf-822c-96e90792fac7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 07 10:36:40.683583 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-b3a4ae5d-172f-4326-ab57-0ead9df2e0a1 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:40.684134 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-b3a4ae5d-172f-4326-ab57-0ead9df2e0a1 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:40.690926 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b3a4ae5d-172f-4326-ab57-0ead9df2e0a1 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:40.691380 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b3a4ae5d-172f-4326-ab57-0ead9df2e0a1 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:40.692710 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b3a4ae5d-172f-4326-ab57-0ead9df2e0a1 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:40.693153 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b3a4ae5d-172f-4326-ab57-0ead9df2e0a1 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:40.706507 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.wsgi [None req-b3a4ae5d-172f-4326-ab57-0ead9df2e0a1 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] HTTP exception thrown: Instance b52e1947-1b4e-4a83-9041-ea3b84be027f could not be found. Jul 07 10:36:40.708688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-b3a4ae5d-172f-4326-ab57-0ead9df2e0a1 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Request method failure captured: Jul 07 10:36:40.708688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: DELETE /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f HTTP/1.1 Jul 07 10:36:40.708688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:36:40.708688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:36:40.708688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:36:40.708688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 0 Jul 07 10:36:40.708688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:36:40.708688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:36:40.708688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:36:40.708688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:36:40.708688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrYEuYwKPnkljHRk0_LP-3RppqXYxDJn2lNWAJneOsf-lRx6WT0_NrypbEEQSItWaO3W8cpEmzNT5WjpjEAPB0TQbNcPkt25V_LEh4yiglMFXVSxfL_2uZcHY4WokoEvFeWe4OUptx5h-iDEfigAwq3jSzFUZu6eeEoLElUei2R-6iQ Jul 07 10:36:40.708688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:36:40.708688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:36:40.708688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:36:40.708688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:36:40.708688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Openstack-Nova-Api-Version: 2.20 Jul 07 10:36:40.708688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:36:40.708688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:36:40.708688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: 96923df6a03841498e3732c8504b6363 Jul 07 10:36:40.708688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1231301553 Jul 07 10:36:40.708688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:36:40.708688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:36:40.710367 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96923df6a03841498e3732c8504b6363"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96923df6a03841498e3732c8504b6363"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96923df6a03841498e3732c8504b6363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96923df6a03841498e3732c8504b6363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:36:40.710367 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1231301553 Jul 07 10:36:40.710367 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: 96923df6a03841498e3732c8504b6363 Jul 07 10:36:40.710367 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1231301553 Jul 07 10:36:40.710367 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-AttachVolumeShelveTestJSON-1231301553-project Jul 07 10:36:40.710367 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:36:40.710367 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:36:40.710367 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: 31bcb5c27d8b4ae2b9a3207fff0eabfe Jul 07 10:36:40.710367 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1231301553-project Jul 07 10:36:40.710367 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: > Jul 07 10:36:40.710367 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Instance b52e1947-1b4e-4a83-9041-ea3b84be027f could not be found. Jul 07 10:36:40.710367 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'id': 'b52e1947-1b4e-4a83-9041-ea3b84be027f'} Jul 07 10:36:40.712395 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:36:40.712395 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:36:40.712395 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:36:40.712395 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:36:40.712395 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:36:40.712395 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:36:40.712395 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:36:40.712395 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:36:40.712395 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:36:40.712395 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:36:40.712395 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b52e1947-1b4e-4a83-9041-ea3b84be027f could not be found. Jul 07 10:36:40.712395 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:36:40.712395 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:36:40.712395 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:36:40.712395 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:36:40.712395 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:36:40.712395 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:36:40.712395 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:36:40.712395 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:36:40.712395 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:36:40.713857 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:36:40.713857 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 10:36:40.713857 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 10:36:40.713857 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 10:36:40.713857 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 10:36:40.713857 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:36:40.713857 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:36:40.713857 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:36:40.713857 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:36:40.713857 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b52e1947-1b4e-4a83-9041-ea3b84be027f could not be found. Jul 07 10:36:40.713857 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:36:40.713857 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:36:40.713857 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:36:40.713857 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:36:40.713857 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:36:40.713857 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:36:40.713857 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:36:40.713857 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:36:40.713857 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b52e1947-1b4e-4a83-9041-ea3b84be027f could not be found. Jul 07 10:36:40.713857 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:36:40.715309 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-b3a4ae5d-172f-4326-ab57-0ead9df2e0a1 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Returning 404 to user: Instance b52e1947-1b4e-4a83-9041-ea3b84be027f could not be found. {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:36:40.715309 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-b3a4ae5d-172f-4326-ab57-0ead9df2e0a1 tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 404 len: 111 microversion: 2.20 time: 0.030669 Jul 07 10:36:40.715309 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 502/985] 10.222.0.16 () {60 vars in 1279 bytes} [Thu Jul 7 10:36:40 2022] DELETE /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 07 10:36:40.718821 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-175455a0-5bd7-488e-a461-fe75774f501c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:40.719429 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-175455a0-5bd7-488e-a461-fe75774f501c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] [instance: b52e1947-1b4e-4a83-9041-ea3b84be027f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:40.725918 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-175455a0-5bd7-488e-a461-fe75774f501c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:40.726370 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-175455a0-5bd7-488e-a461-fe75774f501c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:40.727128 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-175455a0-5bd7-488e-a461-fe75774f501c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:40.727567 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-175455a0-5bd7-488e-a461-fe75774f501c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:40.740614 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-175455a0-5bd7-488e-a461-fe75774f501c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] HTTP exception thrown: Instance b52e1947-1b4e-4a83-9041-ea3b84be027f could not be found. Jul 07 10:36:40.742112 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-175455a0-5bd7-488e-a461-fe75774f501c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Request method failure captured: Jul 07 10:36:40.742112 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f HTTP/1.1 Jul 07 10:36:40.742112 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept: application/json Jul 07 10:36:40.742112 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jul 07 10:36:40.742112 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Connection: close Jul 07 10:36:40.742112 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jul 07 10:36:40.742112 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jul 07 10:36:40.742112 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Host: 10.222.0.16 Jul 07 10:36:40.742112 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jul 07 10:36:40.742112 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jul 07 10:36:40.742112 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABixrYEuYwKPnkljHRk0_LP-3RppqXYxDJn2lNWAJneOsf-lRx6WT0_NrypbEEQSItWaO3W8cpEmzNT5WjpjEAPB0TQbNcPkt25V_LEh4yiglMFXVSxfL_2uZcHY4WokoEvFeWe4OUptx5h-iDEfigAwq3jSzFUZu6eeEoLElUei2R-6iQ Jul 07 10:36:40.742112 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jul 07 10:36:40.742112 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jul 07 10:36:40.742112 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jul 07 10:36:40.742112 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jul 07 10:36:40.742112 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Openstack-Nova-Api-Version: 2.20 Jul 07 10:36:40.742112 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jul 07 10:36:40.742112 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jul 07 10:36:40.742112 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Id: 96923df6a03841498e3732c8504b6363 Jul 07 10:36:40.742112 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1231301553 Jul 07 10:36:40.742112 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jul 07 10:36:40.742112 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jul 07 10:36:40.743808 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96923df6a03841498e3732c8504b6363"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96923df6a03841498e3732c8504b6363"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96923df6a03841498e3732c8504b6363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96923df6a03841498e3732c8504b6363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:36:40.743808 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1231301553 Jul 07 10:36:40.743808 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 96923df6a03841498e3732c8504b6363 Jul 07 10:36:40.743808 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1231301553 Jul 07 10:36:40.743808 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User: tempest-AttachVolumeShelveTestJSON-1231301553-project Jul 07 10:36:40.743808 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jul 07 10:36:40.743808 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jul 07 10:36:40.743808 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Id: 31bcb5c27d8b4ae2b9a3207fff0eabfe Jul 07 10:36:40.743808 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1231301553-project Jul 07 10:36:40.743808 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: method: > Jul 07 10:36:40.743808 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: exception: Instance b52e1947-1b4e-4a83-9041-ea3b84be027f could not be found. Jul 07 10:36:40.743808 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: action_args: {'id': 'b52e1947-1b4e-4a83-9041-ea3b84be027f'} Jul 07 10:36:40.744721 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:36:40.744721 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:36:40.744721 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:36:40.744721 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:36:40.744721 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:36:40.744721 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:36:40.744721 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:36:40.744721 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:36:40.744721 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:36:40.744721 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:36:40.744721 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b52e1947-1b4e-4a83-9041-ea3b84be027f could not be found. Jul 07 10:36:40.744721 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:36:40.744721 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:36:40.744721 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:36:40.744721 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:36:40.744721 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:36:40.744721 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:36:40.744721 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:36:40.744721 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:36:40.744721 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:36:40.746204 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:36:40.746204 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:36:40.746204 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:36:40.746204 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:36:40.746204 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:36:40.746204 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:36:40.746204 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:36:40.746204 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b52e1947-1b4e-4a83-9041-ea3b84be027f could not be found. Jul 07 10:36:40.746204 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:36:40.746204 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:36:40.746204 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:36:40.746204 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:36:40.746204 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:36:40.746204 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:36:40.746204 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:36:40.746204 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:36:40.746204 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b52e1947-1b4e-4a83-9041-ea3b84be027f could not be found. Jul 07 10:36:40.746204 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:36:40.747513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-175455a0-5bd7-488e-a461-fe75774f501c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] Returning 404 to user: Instance b52e1947-1b4e-4a83-9041-ea3b84be027f could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:36:40.747513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-175455a0-5bd7-488e-a461-fe75774f501c tempest-AttachVolumeShelveTestJSON-1231301553 tempest-AttachVolumeShelveTestJSON-1231301553-project] 10.222.0.16 "GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f" status: 404 len: 111 microversion: 2.20 time: 0.028583 Jul 07 10:36:40.747513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 484/986] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jul 7 10:36:40 2022] GET /compute/v2.1/servers/b52e1947-1b4e-4a83-9041-ea3b84be027f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 07 10:36:41.839868 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-3fc4f24c-db36-40d8-a699-d7e4041be21d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:41.840388 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-3fc4f24c-db36-40d8-a699-d7e4041be21d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 3e104062-e8e4-4102-8367-0cf2c09c97d0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:41.844886 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-dac5bd31-c624-458c-95f1-e41632687177 req-67cb1c88-4ee6-4d2f-812b-d1cd3064968a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e104062-e8e4-4102-8367-0cf2c09c97d0", "tag": "216fec1b-d072-4901-a408-a796234144d0"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:36:41.854515 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-dac5bd31-c624-458c-95f1-e41632687177 req-67cb1c88-4ee6-4d2f-812b-d1cd3064968a service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:41.855990 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3fc4f24c-db36-40d8-a699-d7e4041be21d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:41.856844 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3fc4f24c-db36-40d8-a699-d7e4041be21d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:41.857866 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3fc4f24c-db36-40d8-a699-d7e4041be21d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:41.858594 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-3fc4f24c-db36-40d8-a699-d7e4041be21d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:41.858735 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-dac5bd31-c624-458c-95f1-e41632687177 req-67cb1c88-4ee6-4d2f-812b-d1cd3064968a service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:41.872486 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-dac5bd31-c624-458c-95f1-e41632687177 req-67cb1c88-4ee6-4d2f-812b-d1cd3064968a service nova] Creating event network-changed:216fec1b-d072-4901-a408-a796234144d0 for instance 3e104062-e8e4-4102-8367-0cf2c09c97d0 on hv-cinder-82282 Jul 07 10:36:41.878281 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-dac5bd31-c624-458c-95f1-e41632687177 req-67cb1c88-4ee6-4d2f-812b-d1cd3064968a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037311 Jul 07 10:36:41.882935 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 485/987] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 10:36:41.901199 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-3fc4f24c-db36-40d8-a699-d7e4041be21d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 3e104062-e8e4-4102-8367-0cf2c09c97d0] Going to try to terminate instance {{(pid=117646) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 10:36:41.989368 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-3fc4f24c-db36-40d8-a699-d7e4041be21d tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0" status: 204 len: 0 microversion: 2.1 time: 0.154277 Jul 07 10:36:42.000582 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c3bfec03-061b-49f1-b3e4-5b95f75c7d10 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:42.001585 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c3bfec03-061b-49f1-b3e4-5b95f75c7d10 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 3e104062-e8e4-4102-8367-0cf2c09c97d0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:42.003841 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 503/988] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jul 7 10:36:41 2022] DELETE /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 10:36:42.009205 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c3bfec03-061b-49f1-b3e4-5b95f75c7d10 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:42.009870 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c3bfec03-061b-49f1-b3e4-5b95f75c7d10 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:42.010642 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c3bfec03-061b-49f1-b3e4-5b95f75c7d10 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:42.011252 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c3bfec03-061b-49f1-b3e4-5b95f75c7d10 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:42.307503 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c3bfec03-061b-49f1-b3e4-5b95f75c7d10 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:36:42.315799 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c3bfec03-061b-49f1-b3e4-5b95f75c7d10 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0" status: 200 len: 1576 microversion: 2.1 time: 0.320374 Jul 07 10:36:42.326018 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 486/989] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:36:41 2022] GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0 => generated 1576 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:36:43.335106 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-6e3627e3-086e-4d03-9ed6-531342ec3873 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:43.336072 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-6e3627e3-086e-4d03-9ed6-531342ec3873 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 3e104062-e8e4-4102-8367-0cf2c09c97d0] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:43.344604 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6e3627e3-086e-4d03-9ed6-531342ec3873 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:43.345062 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6e3627e3-086e-4d03-9ed6-531342ec3873 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:43.345840 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6e3627e3-086e-4d03-9ed6-531342ec3873 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:43.346284 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-6e3627e3-086e-4d03-9ed6-531342ec3873 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:43.491490 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-6e3627e3-086e-4d03-9ed6-531342ec3873 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:36:43.499523 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-6e3627e3-086e-4d03-9ed6-531342ec3873 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0" status: 200 len: 1576 microversion: 2.1 time: 0.169343 Jul 07 10:36:43.500130 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 504/990] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:36:43 2022] GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:36:44.517826 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5f3114ba-e372-454a-8468-a38a93858120 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:44.518440 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5f3114ba-e372-454a-8468-a38a93858120 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 3e104062-e8e4-4102-8367-0cf2c09c97d0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:44.525581 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5f3114ba-e372-454a-8468-a38a93858120 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:44.526029 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5f3114ba-e372-454a-8468-a38a93858120 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:44.526797 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5f3114ba-e372-454a-8468-a38a93858120 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:44.527230 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5f3114ba-e372-454a-8468-a38a93858120 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:44.639382 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5f3114ba-e372-454a-8468-a38a93858120 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059a87a80fc547db8aeb3bb03003cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a91d56e163442dacf4c5ce7b28a132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:36:44.650175 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5f3114ba-e372-454a-8468-a38a93858120 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0" status: 200 len: 1391 microversion: 2.1 time: 0.136640 Jul 07 10:36:44.650755 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 487/991] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:36:44 2022] GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0 => generated 1391 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:36:44.653932 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-033e7279-44b5-4fa2-a5dd-e65be7190c9f req-1e59b5cc-739f-4f24-b27d-a226ecf27a9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e104062-e8e4-4102-8367-0cf2c09c97d0", "name": "network-vif-deleted", "tag": "216fec1b-d072-4901-a408-a796234144d0"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:36:44.667821 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-033e7279-44b5-4fa2-a5dd-e65be7190c9f req-1e59b5cc-739f-4f24-b27d-a226ecf27a9d service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:44.670851 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-033e7279-44b5-4fa2-a5dd-e65be7190c9f req-1e59b5cc-739f-4f24-b27d-a226ecf27a9d service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:44.683361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-033e7279-44b5-4fa2-a5dd-e65be7190c9f req-1e59b5cc-739f-4f24-b27d-a226ecf27a9d service nova] Creating event network-vif-deleted:216fec1b-d072-4901-a408-a796234144d0 for instance 3e104062-e8e4-4102-8367-0cf2c09c97d0 on hv-cinder-82282 Jul 07 10:36:44.688142 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-033e7279-44b5-4fa2-a5dd-e65be7190c9f req-1e59b5cc-739f-4f24-b27d-a226ecf27a9d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045202 Jul 07 10:36:44.689209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 505/992] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:36:45.667338 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6a1965c8-af55-4d51-a03c-944f0ae61905 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:45.668004 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6a1965c8-af55-4d51-a03c-944f0ae61905 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 3e104062-e8e4-4102-8367-0cf2c09c97d0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:45.674049 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6a1965c8-af55-4d51-a03c-944f0ae61905 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:45.674494 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6a1965c8-af55-4d51-a03c-944f0ae61905 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:45.675247 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6a1965c8-af55-4d51-a03c-944f0ae61905 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:45.675684 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6a1965c8-af55-4d51-a03c-944f0ae61905 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:45.688819 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-6a1965c8-af55-4d51-a03c-944f0ae61905 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] HTTP exception thrown: Instance 3e104062-e8e4-4102-8367-0cf2c09c97d0 could not be found. Jul 07 10:36:45.690709 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6a1965c8-af55-4d51-a03c-944f0ae61905 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Request method failure captured: Jul 07 10:36:45.690709 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0 HTTP/1.1 Jul 07 10:36:45.690709 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept: application/json Jul 07 10:36:45.690709 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jul 07 10:36:45.690709 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Connection: close Jul 07 10:36:45.690709 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jul 07 10:36:45.690709 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jul 07 10:36:45.690709 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Host: 10.222.0.16 Jul 07 10:36:45.690709 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jul 07 10:36:45.690709 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jul 07 10:36:45.690709 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABixrWBVteUyCqdbDELQednwVozbqX_3TVDWbVerzXdDH8pThAeXJI6Hme7Aj69Po7w29VfH5QDBIIPdKnql24pcEXNAywLc35EX6qquSHxXTCKMvhd-Hr1rdv027OK_Q4fyHYTFD6BSCksK7MQq4TvwsxbU5DcDgS6He7rtehl8aUmUjg Jul 07 10:36:45.690709 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jul 07 10:36:45.690709 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jul 07 10:36:45.690709 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jul 07 10:36:45.690709 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jul 07 10:36:45.690709 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jul 07 10:36:45.690709 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jul 07 10:36:45.690709 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Id: 12a91d56e163442dacf4c5ce7b28a132 Jul 07 10:36:45.690709 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-TestVolumeBootPattern-929143946 Jul 07 10:36:45.690709 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jul 07 10:36:45.690709 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jul 07 10:36:45.692930 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/12a91d56e163442dacf4c5ce7b28a132"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/12a91d56e163442dacf4c5ce7b28a132"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/12a91d56e163442dacf4c5ce7b28a132"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_12a91d56e163442dacf4c5ce7b28a132"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:36:45.692930 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-TestVolumeBootPattern-929143946 Jul 07 10:36:45.692930 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 12a91d56e163442dacf4c5ce7b28a132 Jul 07 10:36:45.692930 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-TestVolumeBootPattern-929143946 Jul 07 10:36:45.692930 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User: tempest-TestVolumeBootPattern-929143946-project Jul 07 10:36:45.692930 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jul 07 10:36:45.692930 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jul 07 10:36:45.692930 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Id: 059a87a80fc547db8aeb3bb03003cd2c Jul 07 10:36:45.692930 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-TestVolumeBootPattern-929143946-project Jul 07 10:36:45.692930 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: method: > Jul 07 10:36:45.692930 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: exception: Instance 3e104062-e8e4-4102-8367-0cf2c09c97d0 could not be found. Jul 07 10:36:45.692930 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: action_args: {'id': '3e104062-e8e4-4102-8367-0cf2c09c97d0'} Jul 07 10:36:45.693821 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:36:45.693821 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:36:45.693821 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:36:45.693821 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:36:45.693821 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:36:45.693821 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:36:45.693821 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:36:45.693821 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:36:45.693821 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:36:45.693821 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:36:45.693821 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e104062-e8e4-4102-8367-0cf2c09c97d0 could not be found. Jul 07 10:36:45.693821 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:36:45.693821 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:36:45.693821 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:36:45.693821 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:36:45.693821 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:36:45.693821 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:36:45.693821 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:36:45.693821 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:36:45.693821 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:36:45.695321 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:36:45.695321 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:36:45.695321 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:36:45.695321 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:36:45.695321 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:36:45.695321 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:36:45.695321 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:36:45.695321 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e104062-e8e4-4102-8367-0cf2c09c97d0 could not be found. Jul 07 10:36:45.695321 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:36:45.695321 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:36:45.695321 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:36:45.695321 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:36:45.695321 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:36:45.695321 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:36:45.695321 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:36:45.695321 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:36:45.695321 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e104062-e8e4-4102-8367-0cf2c09c97d0 could not be found. Jul 07 10:36:45.695321 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:36:45.696702 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6a1965c8-af55-4d51-a03c-944f0ae61905 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Returning 404 to user: Instance 3e104062-e8e4-4102-8367-0cf2c09c97d0 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:36:45.696702 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6a1965c8-af55-4d51-a03c-944f0ae61905 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0" status: 404 len: 111 microversion: 2.1 time: 0.028488 Jul 07 10:36:45.696702 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 488/993] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:36:45 2022] GET /compute/v2.1/servers/3e104062-e8e4-4102-8367-0cf2c09c97d0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:36:46.143577 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-c1f726fb-5e41-4a53-bbd0-9f8cb27b3344 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:46.144347 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-c1f726fb-5e41-4a53-bbd0-9f8cb27b3344 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:46.151466 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c1f726fb-5e41-4a53-bbd0-9f8cb27b3344 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:46.152247 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c1f726fb-5e41-4a53-bbd0-9f8cb27b3344 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:46.153025 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c1f726fb-5e41-4a53-bbd0-9f8cb27b3344 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:46.153461 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-c1f726fb-5e41-4a53-bbd0-9f8cb27b3344 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:46.167377 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.wsgi [None req-c1f726fb-5e41-4a53-bbd0-9f8cb27b3344 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] HTTP exception thrown: Instance 2364e764-0c0a-493f-bc92-2f8701294428 could not be found. Jul 07 10:36:46.169237 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-c1f726fb-5e41-4a53-bbd0-9f8cb27b3344 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Request method failure captured: Jul 07 10:36:46.169237 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: DELETE /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 HTTP/1.1 Jul 07 10:36:46.169237 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:36:46.169237 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:36:46.169237 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:36:46.169237 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 0 Jul 07 10:36:46.169237 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:36:46.169237 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:36:46.169237 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:36:46.169237 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:36:46.169237 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrWBVteUyCqdbDELQednwVozbqX_3TVDWbVerzXdDH8pThAeXJI6Hme7Aj69Po7w29VfH5QDBIIPdKnql24pcEXNAywLc35EX6qquSHxXTCKMvhd-Hr1rdv027OK_Q4fyHYTFD6BSCksK7MQq4TvwsxbU5DcDgS6He7rtehl8aUmUjg Jul 07 10:36:46.169237 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:36:46.169237 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:36:46.169237 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:36:46.169237 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:36:46.169237 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:36:46.169237 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:36:46.169237 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: 12a91d56e163442dacf4c5ce7b28a132 Jul 07 10:36:46.169237 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-TestVolumeBootPattern-929143946 Jul 07 10:36:46.169237 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:36:46.169237 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:36:46.170932 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/12a91d56e163442dacf4c5ce7b28a132"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/12a91d56e163442dacf4c5ce7b28a132"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/12a91d56e163442dacf4c5ce7b28a132"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_12a91d56e163442dacf4c5ce7b28a132"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:36:46.170932 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-TestVolumeBootPattern-929143946 Jul 07 10:36:46.170932 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: 12a91d56e163442dacf4c5ce7b28a132 Jul 07 10:36:46.170932 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-TestVolumeBootPattern-929143946 Jul 07 10:36:46.170932 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-TestVolumeBootPattern-929143946-project Jul 07 10:36:46.170932 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:36:46.170932 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:36:46.170932 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: 059a87a80fc547db8aeb3bb03003cd2c Jul 07 10:36:46.170932 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-TestVolumeBootPattern-929143946-project Jul 07 10:36:46.170932 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: > Jul 07 10:36:46.170932 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Instance 2364e764-0c0a-493f-bc92-2f8701294428 could not be found. Jul 07 10:36:46.170932 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'id': '2364e764-0c0a-493f-bc92-2f8701294428'} Jul 07 10:36:46.172040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:36:46.172040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:36:46.172040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:36:46.172040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:36:46.172040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:36:46.172040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:36:46.172040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:36:46.172040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:36:46.172040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:36:46.172040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:36:46.172040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2364e764-0c0a-493f-bc92-2f8701294428 could not be found. Jul 07 10:36:46.172040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:36:46.172040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:36:46.172040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:36:46.172040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:36:46.172040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:36:46.172040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:36:46.172040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:36:46.172040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:36:46.172040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:36:46.173361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:36:46.173361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 10:36:46.173361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 10:36:46.173361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 10:36:46.173361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 10:36:46.173361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:36:46.173361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:36:46.173361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:36:46.173361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:36:46.173361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2364e764-0c0a-493f-bc92-2f8701294428 could not be found. Jul 07 10:36:46.173361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:36:46.173361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:36:46.173361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:36:46.173361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:36:46.173361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:36:46.173361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:36:46.173361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:36:46.173361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:36:46.173361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2364e764-0c0a-493f-bc92-2f8701294428 could not be found. Jul 07 10:36:46.173361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:36:46.175040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-c1f726fb-5e41-4a53-bbd0-9f8cb27b3344 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Returning 404 to user: Instance 2364e764-0c0a-493f-bc92-2f8701294428 could not be found. {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:36:46.175040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-c1f726fb-5e41-4a53-bbd0-9f8cb27b3344 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428" status: 404 len: 111 microversion: 2.1 time: 0.033056 Jul 07 10:36:46.175040 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 506/994] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jul 7 10:36:46 2022] DELETE /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:36:46.180321 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-98ce3f14-f538-44e3-b843-2d781d674135 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:46.180928 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-98ce3f14-f538-44e3-b843-2d781d674135 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] [instance: 2364e764-0c0a-493f-bc92-2f8701294428] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:46.187023 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-98ce3f14-f538-44e3-b843-2d781d674135 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:46.187611 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-98ce3f14-f538-44e3-b843-2d781d674135 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:46.188238 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-98ce3f14-f538-44e3-b843-2d781d674135 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:46.188661 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-98ce3f14-f538-44e3-b843-2d781d674135 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:46.203491 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-98ce3f14-f538-44e3-b843-2d781d674135 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] HTTP exception thrown: Instance 2364e764-0c0a-493f-bc92-2f8701294428 could not be found. Jul 07 10:36:46.205073 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-98ce3f14-f538-44e3-b843-2d781d674135 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Request method failure captured: Jul 07 10:36:46.205073 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 HTTP/1.1 Jul 07 10:36:46.205073 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept: application/json Jul 07 10:36:46.205073 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jul 07 10:36:46.205073 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Connection: close Jul 07 10:36:46.205073 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jul 07 10:36:46.205073 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jul 07 10:36:46.205073 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Host: 10.222.0.16 Jul 07 10:36:46.205073 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jul 07 10:36:46.205073 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jul 07 10:36:46.205073 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABixrWBVteUyCqdbDELQednwVozbqX_3TVDWbVerzXdDH8pThAeXJI6Hme7Aj69Po7w29VfH5QDBIIPdKnql24pcEXNAywLc35EX6qquSHxXTCKMvhd-Hr1rdv027OK_Q4fyHYTFD6BSCksK7MQq4TvwsxbU5DcDgS6He7rtehl8aUmUjg Jul 07 10:36:46.205073 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jul 07 10:36:46.205073 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jul 07 10:36:46.205073 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jul 07 10:36:46.205073 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jul 07 10:36:46.205073 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jul 07 10:36:46.205073 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jul 07 10:36:46.205073 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Id: 12a91d56e163442dacf4c5ce7b28a132 Jul 07 10:36:46.205073 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-TestVolumeBootPattern-929143946 Jul 07 10:36:46.205073 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jul 07 10:36:46.205073 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jul 07 10:36:46.206876 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/12a91d56e163442dacf4c5ce7b28a132"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/12a91d56e163442dacf4c5ce7b28a132"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/12a91d56e163442dacf4c5ce7b28a132"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_12a91d56e163442dacf4c5ce7b28a132"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:36:46.206876 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-TestVolumeBootPattern-929143946 Jul 07 10:36:46.206876 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 12a91d56e163442dacf4c5ce7b28a132 Jul 07 10:36:46.206876 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-TestVolumeBootPattern-929143946 Jul 07 10:36:46.206876 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User: tempest-TestVolumeBootPattern-929143946-project Jul 07 10:36:46.206876 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jul 07 10:36:46.206876 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jul 07 10:36:46.206876 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Id: 059a87a80fc547db8aeb3bb03003cd2c Jul 07 10:36:46.206876 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-TestVolumeBootPattern-929143946-project Jul 07 10:36:46.206876 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: method: > Jul 07 10:36:46.206876 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: exception: Instance 2364e764-0c0a-493f-bc92-2f8701294428 could not be found. Jul 07 10:36:46.206876 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: action_args: {'id': '2364e764-0c0a-493f-bc92-2f8701294428'} Jul 07 10:36:46.208074 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:36:46.208074 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:36:46.208074 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:36:46.208074 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:36:46.208074 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:36:46.208074 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:36:46.208074 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:36:46.208074 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:36:46.208074 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:36:46.208074 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:36:46.208074 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2364e764-0c0a-493f-bc92-2f8701294428 could not be found. Jul 07 10:36:46.208074 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:36:46.208074 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:36:46.208074 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:36:46.208074 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:36:46.208074 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:36:46.208074 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:36:46.208074 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:36:46.208074 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:36:46.208074 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:36:46.209594 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:36:46.209594 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:36:46.209594 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:36:46.209594 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:36:46.209594 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:36:46.209594 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:36:46.209594 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:36:46.209594 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2364e764-0c0a-493f-bc92-2f8701294428 could not be found. Jul 07 10:36:46.209594 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:36:46.209594 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:36:46.209594 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:36:46.209594 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:36:46.209594 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:36:46.209594 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:36:46.209594 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:36:46.209594 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:36:46.209594 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2364e764-0c0a-493f-bc92-2f8701294428 could not be found. Jul 07 10:36:46.209594 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:36:46.210919 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-98ce3f14-f538-44e3-b843-2d781d674135 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Returning 404 to user: Instance 2364e764-0c0a-493f-bc92-2f8701294428 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:36:46.210919 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-98ce3f14-f538-44e3-b843-2d781d674135 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428" status: 404 len: 111 microversion: 2.1 time: 0.030547 Jul 07 10:36:46.210919 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 489/995] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:36:46 2022] GET /compute/v2.1/servers/2364e764-0c0a-493f-bc92-2f8701294428 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:36:47.504783 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-a56f5e0d-c143-4d76-b67f-3e3532931e84 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] Calling method '.version_select at 0x7f9e9e5184c0>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:47.530053 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-a56f5e0d-c143-4d76-b67f-3e3532931e84 tempest-TestVolumeBootPattern-929143946 tempest-TestVolumeBootPattern-929143946-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-800154750" status: 202 len: 0 microversion: 2.1 time: 0.029257 Jul 07 10:36:47.531051 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 507/996] 10.222.0.16 () {58 vars in 1259 bytes} [Thu Jul 7 10:36:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-800154750 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 10:36:51.708260 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c36f4141-9738-492d-8271-aaf02d63d863 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:36:51.709442 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c36f4141-9738-492d-8271-aaf02d63d863 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 4b00fddd-6b8f-484d-baca-59c54ff53aa3] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:51.717149 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c36f4141-9738-492d-8271-aaf02d63d863 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:51.717907 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c36f4141-9738-492d-8271-aaf02d63d863 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:51.718684 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c36f4141-9738-492d-8271-aaf02d63d863 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:51.719319 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c36f4141-9738-492d-8271-aaf02d63d863 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:51.743122 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c36f4141-9738-492d-8271-aaf02d63d863 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3/ips" status: 200 len: 150 microversion: 2.1 time: 0.040169 Jul 07 10:36:51.744105 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 490/997] 10.222.0.16 () {58 vars in 1247 bytes} [Thu Jul 7 10:36:51 2022] GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 10:36:53.084195 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-2e7a0dfc-0a17-45e2-9f3f-45967f455425 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "741bd97c-9907-4aaa-9eba-14df066d67bd"}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:36:53.085866 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-2e7a0dfc-0a17-45e2-9f3f-45967f455425 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 4b00fddd-6b8f-484d-baca-59c54ff53aa3] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:36:53.093033 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2e7a0dfc-0a17-45e2-9f3f-45967f455425 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:53.093718 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2e7a0dfc-0a17-45e2-9f3f-45967f455425 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:53.094669 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2e7a0dfc-0a17-45e2-9f3f-45967f455425 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:36:53.095272 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-2e7a0dfc-0a17-45e2-9f3f-45967f455425 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:36:53.430012 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-2e7a0dfc-0a17-45e2-9f3f-45967f455425 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "POST /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.350116 Jul 07 10:36:53.435523 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 508/998] 10.222.0.16 () {60 vars in 1322 bytes} [Thu Jul 7 10:36:53 2022] POST /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3/os-volume_attachments => generated 194 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:37:00.058331 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c50eb9c3-c38f-43f9-9126-54f138223d84 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:00.059682 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c50eb9c3-c38f-43f9-9126-54f138223d84 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 4b00fddd-6b8f-484d-baca-59c54ff53aa3] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:37:00.069035 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c50eb9c3-c38f-43f9-9126-54f138223d84 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:00.069561 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c50eb9c3-c38f-43f9-9126-54f138223d84 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:00.070397 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c50eb9c3-c38f-43f9-9126-54f138223d84 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:00.070902 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c50eb9c3-c38f-43f9-9126-54f138223d84 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:00.156071 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.objects.instance [None req-c50eb9c3-c38f-43f9-9126-54f138223d84 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lazy-loading 'services' on Instance uuid 4b00fddd-6b8f-484d-baca-59c54ff53aa3 {{(pid=117647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 10:37:00.237472 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c50eb9c3-c38f-43f9-9126-54f138223d84 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3/os-volume_attachments/741bd97c-9907-4aaa-9eba-14df066d67bd" status: 202 len: 0 microversion: 2.1 time: 0.183608 Jul 07 10:37:00.238657 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 491/999] 10.222.0.16 () {58 vars in 1415 bytes} [Thu Jul 7 10:37:00 2022] DELETE /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3/os-volume_attachments/741bd97c-9907-4aaa-9eba-14df066d67bd => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 10:37:00.247721 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-5374445f-fa72-4a3d-b082-b46cc6faee3f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:00.249501 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-5374445f-fa72-4a3d-b082-b46cc6faee3f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 4b00fddd-6b8f-484d-baca-59c54ff53aa3] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:37:00.256735 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5374445f-fa72-4a3d-b082-b46cc6faee3f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:00.257403 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5374445f-fa72-4a3d-b082-b46cc6faee3f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:00.258361 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5374445f-fa72-4a3d-b082-b46cc6faee3f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:00.259004 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-5374445f-fa72-4a3d-b082-b46cc6faee3f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:00.299027 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-5374445f-fa72-4a3d-b082-b46cc6faee3f tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056212 Jul 07 10:37:00.299602 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 509/1000] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jul 7 10:37:00 2022] GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:37:01.311412 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-78cef2b9-dea4-4e71-a86c-203e1c01c307 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:01.312463 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-78cef2b9-dea4-4e71-a86c-203e1c01c307 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 4b00fddd-6b8f-484d-baca-59c54ff53aa3] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:37:01.319463 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-78cef2b9-dea4-4e71-a86c-203e1c01c307 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:01.319951 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-78cef2b9-dea4-4e71-a86c-203e1c01c307 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:01.320726 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-78cef2b9-dea4-4e71-a86c-203e1c01c307 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:01.321163 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-78cef2b9-dea4-4e71-a86c-203e1c01c307 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:01.351014 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-78cef2b9-dea4-4e71-a86c-203e1c01c307 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044347 Jul 07 10:37:01.351850 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 492/1001] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jul 7 10:37:01 2022] GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 10:37:01.413215 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-010cbbf4-3609-4f01-9b1d-5d9b8fb65292 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:01.413739 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-010cbbf4-3609-4f01-9b1d-5d9b8fb65292 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 4b00fddd-6b8f-484d-baca-59c54ff53aa3] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:37:01.420080 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-010cbbf4-3609-4f01-9b1d-5d9b8fb65292 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:01.420540 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-010cbbf4-3609-4f01-9b1d-5d9b8fb65292 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:01.421319 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-010cbbf4-3609-4f01-9b1d-5d9b8fb65292 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:01.421760 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-010cbbf4-3609-4f01-9b1d-5d9b8fb65292 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:01.450838 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-010cbbf4-3609-4f01-9b1d-5d9b8fb65292 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 4b00fddd-6b8f-484d-baca-59c54ff53aa3] Going to try to terminate instance {{(pid=117646) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 10:37:01.453789 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:37:01.536104 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-010cbbf4-3609-4f01-9b1d-5d9b8fb65292 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3" status: 204 len: 0 microversion: 2.1 time: 0.126828 Jul 07 10:37:01.537225 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 510/1002] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jul 7 10:37:01 2022] DELETE /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 10:37:01.545561 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6d67ae68-35f8-415e-9c28-5945549dbcb7 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:01.546173 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6d67ae68-35f8-415e-9c28-5945549dbcb7 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 4b00fddd-6b8f-484d-baca-59c54ff53aa3] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:37:01.552871 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6d67ae68-35f8-415e-9c28-5945549dbcb7 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:01.553404 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6d67ae68-35f8-415e-9c28-5945549dbcb7 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:01.554178 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6d67ae68-35f8-415e-9c28-5945549dbcb7 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:01.554612 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6d67ae68-35f8-415e-9c28-5945549dbcb7 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:01.722401 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6d67ae68-35f8-415e-9c28-5945549dbcb7 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:37:01.730788 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6d67ae68-35f8-415e-9c28-5945549dbcb7 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3" status: 200 len: 1682 microversion: 2.1 time: 0.189207 Jul 07 10:37:01.731512 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 493/1003] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:37:01 2022] GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3 => generated 1682 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:37:02.757406 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-7b6d1934-5ba8-472c-942d-d81ee9cb85f8 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:02.758015 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-7b6d1934-5ba8-472c-942d-d81ee9cb85f8 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 4b00fddd-6b8f-484d-baca-59c54ff53aa3] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:37:02.764369 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7b6d1934-5ba8-472c-942d-d81ee9cb85f8 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:02.764824 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7b6d1934-5ba8-472c-942d-d81ee9cb85f8 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:02.765586 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7b6d1934-5ba8-472c-942d-d81ee9cb85f8 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:02.766025 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-7b6d1934-5ba8-472c-942d-d81ee9cb85f8 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:02.893962 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.policy [None req-7b6d1934-5ba8-472c-942d-d81ee9cb85f8 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:37:02.901426 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-7b6d1934-5ba8-472c-942d-d81ee9cb85f8 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3" status: 200 len: 1682 microversion: 2.1 time: 0.148931 Jul 07 10:37:02.901990 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 511/1004] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:37:02 2022] GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:37:03.918548 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4f90c22d-dbc9-4617-a6b9-a6e7f0aeb82c tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:03.919196 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-4f90c22d-dbc9-4617-a6b9-a6e7f0aeb82c tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 4b00fddd-6b8f-484d-baca-59c54ff53aa3] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:37:03.921814 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:37:03.927692 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4f90c22d-dbc9-4617-a6b9-a6e7f0aeb82c tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:03.928185 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4f90c22d-dbc9-4617-a6b9-a6e7f0aeb82c tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:03.928960 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4f90c22d-dbc9-4617-a6b9-a6e7f0aeb82c tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:03.929400 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4f90c22d-dbc9-4617-a6b9-a6e7f0aeb82c tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:03.933938 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:37:04.009530 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-4f90c22d-dbc9-4617-a6b9-a6e7f0aeb82c tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1222d8bb50554d64ac674f109b6ad077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1568d5b1c4bb471f9de53f4d5cf7cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 10:37:04.017018 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-4f90c22d-dbc9-4617-a6b9-a6e7f0aeb82c tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3" status: 200 len: 1615 microversion: 2.1 time: 0.102363 Jul 07 10:37:04.017592 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 494/1005] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:37:03 2022] GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3 => generated 1615 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:37:04.180006 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [req-2e4fc0be-9dbb-4534-b39c-89a5000e1426 req-74af1cff-9034-40d7-8b03-66a273e40d50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b00fddd-6b8f-484d-baca-59c54ff53aa3", "name": "network-vif-deleted", "tag": "2f90a7b1-2d24-4e33-97da-f26156c08547"}]} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:37:04.185256 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:37:04.189444 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-2e4fc0be-9dbb-4534-b39c-89a5000e1426 req-74af1cff-9034-40d7-8b03-66a273e40d50 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:04.189893 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [req-2e4fc0be-9dbb-4534-b39c-89a5000e1426 req-74af1cff-9034-40d7-8b03-66a273e40d50 service nova] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:04.204480 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.compute.server_external_events [req-2e4fc0be-9dbb-4534-b39c-89a5000e1426 req-74af1cff-9034-40d7-8b03-66a273e40d50 service nova] Creating event network-vif-deleted:2f90a7b1-2d24-4e33-97da-f26156c08547 for instance 4b00fddd-6b8f-484d-baca-59c54ff53aa3 on hv-cinder-82282 Jul 07 10:37:04.210047 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [req-2e4fc0be-9dbb-4534-b39c-89a5000e1426 req-74af1cff-9034-40d7-8b03-66a273e40d50 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034009 Jul 07 10:37:04.210573 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 512/1006] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jul 7 10:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:37:05.033920 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-abf4d3fc-fbe2-428f-976f-3cf64214fc40 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:05.034558 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-abf4d3fc-fbe2-428f-976f-3cf64214fc40 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 4b00fddd-6b8f-484d-baca-59c54ff53aa3] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:37:05.041361 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-abf4d3fc-fbe2-428f-976f-3cf64214fc40 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:05.041793 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-abf4d3fc-fbe2-428f-976f-3cf64214fc40 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:05.042567 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-abf4d3fc-fbe2-428f-976f-3cf64214fc40 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:05.043337 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-abf4d3fc-fbe2-428f-976f-3cf64214fc40 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:05.065037 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-abf4d3fc-fbe2-428f-976f-3cf64214fc40 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] HTTP exception thrown: Instance 4b00fddd-6b8f-484d-baca-59c54ff53aa3 could not be found. Jul 07 10:37:05.067537 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-abf4d3fc-fbe2-428f-976f-3cf64214fc40 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Request method failure captured: Jul 07 10:37:05.067537 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3 HTTP/1.1 Jul 07 10:37:05.067537 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept: application/json Jul 07 10:37:05.067537 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jul 07 10:37:05.067537 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Connection: close Jul 07 10:37:05.067537 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jul 07 10:37:05.067537 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jul 07 10:37:05.067537 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Host: 10.222.0.16 Jul 07 10:37:05.067537 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jul 07 10:37:05.067537 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jul 07 10:37:05.067537 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABixrY8OvCBMJnjRdOGiniYdWVQXRU5j_oL_-3IW8B050mI9iTiMiAqckVcFrYUNMDNBzu5A7KjWAw4CfsePxF_lhVKdStuWP73EE48s908WgfQ_p-BUvui7Lff6JDUFqsZcmbVchhpCEcFgE514wUYqWgw2aG015Cpl2jakkhdOE3Gcxc Jul 07 10:37:05.067537 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jul 07 10:37:05.067537 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jul 07 10:37:05.067537 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jul 07 10:37:05.067537 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jul 07 10:37:05.067537 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jul 07 10:37:05.067537 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jul 07 10:37:05.067537 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Id: 1568d5b1c4bb471f9de53f4d5cf7cc82 Jul 07 10:37:05.067537 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:37:05.067537 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jul 07 10:37:05.067537 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jul 07 10:37:05.069875 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:37:05.069875 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:37:05.069875 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 1568d5b1c4bb471f9de53f4d5cf7cc82 Jul 07 10:37:05.069875 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:37:05.069875 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User: tempest-AttachVolumeNegativeTest-1710795981-project Jul 07 10:37:05.069875 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jul 07 10:37:05.069875 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jul 07 10:37:05.069875 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Id: 1222d8bb50554d64ac674f109b6ad077 Jul 07 10:37:05.069875 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-AttachVolumeNegativeTest-1710795981-project Jul 07 10:37:05.069875 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: method: > Jul 07 10:37:05.069875 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: exception: Instance 4b00fddd-6b8f-484d-baca-59c54ff53aa3 could not be found. Jul 07 10:37:05.069875 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: action_args: {'id': '4b00fddd-6b8f-484d-baca-59c54ff53aa3'} Jul 07 10:37:05.070798 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:37:05.070798 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:05.070798 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:37:05.070798 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:37:05.070798 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:37:05.070798 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:37:05.070798 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:37:05.070798 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:37:05.070798 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:37:05.070798 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:37:05.070798 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b00fddd-6b8f-484d-baca-59c54ff53aa3 could not be found. Jul 07 10:37:05.070798 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:05.070798 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:37:05.070798 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:05.070798 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:05.070798 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:37:05.070798 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:37:05.070798 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:37:05.070798 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:37:05.070798 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:37:05.072150 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:37:05.072150 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:37:05.072150 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:37:05.072150 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:37:05.072150 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:37:05.072150 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:37:05.072150 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:37:05.072150 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b00fddd-6b8f-484d-baca-59c54ff53aa3 could not be found. Jul 07 10:37:05.072150 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:05.072150 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:37:05.072150 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:05.072150 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:05.072150 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:37:05.072150 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:37:05.072150 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:37:05.072150 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:37:05.072150 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b00fddd-6b8f-484d-baca-59c54ff53aa3 could not be found. Jul 07 10:37:05.072150 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:05.073374 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-abf4d3fc-fbe2-428f-976f-3cf64214fc40 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Returning 404 to user: Instance 4b00fddd-6b8f-484d-baca-59c54ff53aa3 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:37:05.073374 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-abf4d3fc-fbe2-428f-976f-3cf64214fc40 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3" status: 404 len: 111 microversion: 2.1 time: 0.040848 Jul 07 10:37:05.074380 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 495/1007] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:37:05 2022] GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:37:05.079929 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-fa3aa96c-e9e9-47e4-8aea-21308d0b2902 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '.version_select at 0x7f9e9e4f0af0>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:05.099702 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-fa3aa96c-e9e9-47e4-8aea-21308d0b2902 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1353623448" status: 202 len: 0 microversion: 2.1 time: 0.023790 Jul 07 10:37:05.100521 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 513/1008] 10.222.0.16 () {58 vars in 1220 bytes} [Thu Jul 7 10:37:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1353623448 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 07 10:37:06.839672 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-78f9302a-5124-47fb-9e86-466383c1f8b8 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:06.840188 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-78f9302a-5124-47fb-9e86-466383c1f8b8 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 4b00fddd-6b8f-484d-baca-59c54ff53aa3] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:37:06.846550 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-78f9302a-5124-47fb-9e86-466383c1f8b8 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:06.846997 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-78f9302a-5124-47fb-9e86-466383c1f8b8 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:06.847766 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-78f9302a-5124-47fb-9e86-466383c1f8b8 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:06.848211 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-78f9302a-5124-47fb-9e86-466383c1f8b8 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:06.861685 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-78f9302a-5124-47fb-9e86-466383c1f8b8 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] HTTP exception thrown: Instance 4b00fddd-6b8f-484d-baca-59c54ff53aa3 could not be found. Jul 07 10:37:06.863261 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-78f9302a-5124-47fb-9e86-466383c1f8b8 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Request method failure captured: Jul 07 10:37:06.863261 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: request: DELETE /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3 HTTP/1.1 Jul 07 10:37:06.863261 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept: application/json Jul 07 10:37:06.863261 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jul 07 10:37:06.863261 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Connection: close Jul 07 10:37:06.863261 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jul 07 10:37:06.863261 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jul 07 10:37:06.863261 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Host: 10.222.0.16 Jul 07 10:37:06.863261 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jul 07 10:37:06.863261 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jul 07 10:37:06.863261 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABixrY8OvCBMJnjRdOGiniYdWVQXRU5j_oL_-3IW8B050mI9iTiMiAqckVcFrYUNMDNBzu5A7KjWAw4CfsePxF_lhVKdStuWP73EE48s908WgfQ_p-BUvui7Lff6JDUFqsZcmbVchhpCEcFgE514wUYqWgw2aG015Cpl2jakkhdOE3Gcxc Jul 07 10:37:06.863261 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jul 07 10:37:06.863261 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jul 07 10:37:06.863261 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jul 07 10:37:06.863261 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jul 07 10:37:06.863261 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jul 07 10:37:06.863261 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jul 07 10:37:06.863261 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Id: 1568d5b1c4bb471f9de53f4d5cf7cc82 Jul 07 10:37:06.863261 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:37:06.863261 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jul 07 10:37:06.863261 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jul 07 10:37:06.864904 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:37:06.864904 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:37:06.864904 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 1568d5b1c4bb471f9de53f4d5cf7cc82 Jul 07 10:37:06.864904 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:37:06.864904 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User: tempest-AttachVolumeNegativeTest-1710795981-project Jul 07 10:37:06.864904 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jul 07 10:37:06.864904 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jul 07 10:37:06.864904 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Id: 1222d8bb50554d64ac674f109b6ad077 Jul 07 10:37:06.864904 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-AttachVolumeNegativeTest-1710795981-project Jul 07 10:37:06.864904 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: method: > Jul 07 10:37:06.864904 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: exception: Instance 4b00fddd-6b8f-484d-baca-59c54ff53aa3 could not be found. Jul 07 10:37:06.864904 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: action_args: {'id': '4b00fddd-6b8f-484d-baca-59c54ff53aa3'} Jul 07 10:37:06.866421 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:37:06.866421 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:06.866421 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:37:06.866421 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:37:06.866421 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:37:06.866421 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:37:06.866421 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:37:06.866421 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:37:06.866421 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:37:06.866421 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:37:06.866421 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b00fddd-6b8f-484d-baca-59c54ff53aa3 could not be found. Jul 07 10:37:06.866421 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:06.866421 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:37:06.866421 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:06.866421 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:06.866421 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:37:06.866421 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:37:06.866421 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:37:06.866421 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:37:06.866421 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:37:06.867870 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:37:06.867870 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 10:37:06.867870 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 10:37:06.867870 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 10:37:06.867870 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 10:37:06.867870 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:37:06.867870 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:37:06.867870 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:37:06.867870 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:37:06.867870 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b00fddd-6b8f-484d-baca-59c54ff53aa3 could not be found. Jul 07 10:37:06.867870 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:06.867870 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:37:06.867870 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:06.867870 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:06.867870 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:37:06.867870 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:37:06.867870 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:37:06.867870 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:37:06.867870 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b00fddd-6b8f-484d-baca-59c54ff53aa3 could not be found. Jul 07 10:37:06.867870 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:06.869443 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-78f9302a-5124-47fb-9e86-466383c1f8b8 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Returning 404 to user: Instance 4b00fddd-6b8f-484d-baca-59c54ff53aa3 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:37:06.869443 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-78f9302a-5124-47fb-9e86-466383c1f8b8 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3" status: 404 len: 111 microversion: 2.1 time: 0.028797 Jul 07 10:37:06.869443 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 496/1009] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jul 7 10:37:06 2022] DELETE /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:37:06.874701 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-011a73fd-ba2c-462e-a393-756ad945cb30 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:06.875438 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-011a73fd-ba2c-462e-a393-756ad945cb30 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 4b00fddd-6b8f-484d-baca-59c54ff53aa3] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:37:06.881598 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-011a73fd-ba2c-462e-a393-756ad945cb30 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:06.882053 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-011a73fd-ba2c-462e-a393-756ad945cb30 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:06.882818 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-011a73fd-ba2c-462e-a393-756ad945cb30 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:06.883270 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-011a73fd-ba2c-462e-a393-756ad945cb30 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:06.896500 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.wsgi [None req-011a73fd-ba2c-462e-a393-756ad945cb30 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] HTTP exception thrown: Instance 4b00fddd-6b8f-484d-baca-59c54ff53aa3 could not be found. Jul 07 10:37:06.898102 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-011a73fd-ba2c-462e-a393-756ad945cb30 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Request method failure captured: Jul 07 10:37:06.898102 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3 HTTP/1.1 Jul 07 10:37:06.898102 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:37:06.898102 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:37:06.898102 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:37:06.898102 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 0 Jul 07 10:37:06.898102 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:37:06.898102 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:37:06.898102 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:37:06.898102 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:37:06.898102 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrY8OvCBMJnjRdOGiniYdWVQXRU5j_oL_-3IW8B050mI9iTiMiAqckVcFrYUNMDNBzu5A7KjWAw4CfsePxF_lhVKdStuWP73EE48s908WgfQ_p-BUvui7Lff6JDUFqsZcmbVchhpCEcFgE514wUYqWgw2aG015Cpl2jakkhdOE3Gcxc Jul 07 10:37:06.898102 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:37:06.898102 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:37:06.898102 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:37:06.898102 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:37:06.898102 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:37:06.898102 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:37:06.898102 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: 1568d5b1c4bb471f9de53f4d5cf7cc82 Jul 07 10:37:06.898102 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:37:06.898102 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:37:06.898102 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:37:06.899644 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:37:06.899644 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:37:06.899644 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: 1568d5b1c4bb471f9de53f4d5cf7cc82 Jul 07 10:37:06.899644 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:37:06.899644 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-AttachVolumeNegativeTest-1710795981-project Jul 07 10:37:06.899644 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:37:06.899644 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:37:06.899644 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: 1222d8bb50554d64ac674f109b6ad077 Jul 07 10:37:06.899644 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-AttachVolumeNegativeTest-1710795981-project Jul 07 10:37:06.899644 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: > Jul 07 10:37:06.899644 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Instance 4b00fddd-6b8f-484d-baca-59c54ff53aa3 could not be found. Jul 07 10:37:06.899644 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'id': '4b00fddd-6b8f-484d-baca-59c54ff53aa3'} Jul 07 10:37:06.900715 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:37:06.900715 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:06.900715 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:37:06.900715 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:37:06.900715 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:37:06.900715 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:37:06.900715 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:37:06.900715 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:37:06.900715 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:37:06.900715 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:37:06.900715 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b00fddd-6b8f-484d-baca-59c54ff53aa3 could not be found. Jul 07 10:37:06.900715 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:06.900715 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:37:06.900715 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:06.900715 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:06.900715 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:37:06.900715 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:37:06.900715 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:37:06.900715 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:37:06.900715 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:37:06.902207 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:37:06.902207 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:37:06.902207 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:37:06.902207 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:37:06.902207 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:37:06.902207 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:37:06.902207 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:37:06.902207 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b00fddd-6b8f-484d-baca-59c54ff53aa3 could not be found. Jul 07 10:37:06.902207 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:06.902207 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:37:06.902207 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:06.902207 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:06.902207 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:37:06.902207 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:37:06.902207 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:37:06.902207 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:37:06.902207 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b00fddd-6b8f-484d-baca-59c54ff53aa3 could not be found. Jul 07 10:37:06.902207 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:06.906554 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-011a73fd-ba2c-462e-a393-756ad945cb30 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Returning 404 to user: Instance 4b00fddd-6b8f-484d-baca-59c54ff53aa3 could not be found. {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:37:06.906554 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-011a73fd-ba2c-462e-a393-756ad945cb30 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3" status: 404 len: 111 microversion: 2.1 time: 0.029193 Jul 07 10:37:06.906554 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 514/1010] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:37:06 2022] GET /compute/v2.1/servers/4b00fddd-6b8f-484d-baca-59c54ff53aa3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:37:08.032978 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ded4c735-0514-49d5-8e7f-ec6853325d7a tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:08.033475 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ded4c735-0514-49d5-8e7f-ec6853325d7a tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: b25327c6-c3ad-44eb-90ef-3ab8e86c426e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:37:08.040173 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ded4c735-0514-49d5-8e7f-ec6853325d7a tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:08.040980 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ded4c735-0514-49d5-8e7f-ec6853325d7a tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:08.041737 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ded4c735-0514-49d5-8e7f-ec6853325d7a tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:08.042173 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ded4c735-0514-49d5-8e7f-ec6853325d7a tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:08.055724 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-ded4c735-0514-49d5-8e7f-ec6853325d7a tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] HTTP exception thrown: Instance b25327c6-c3ad-44eb-90ef-3ab8e86c426e could not be found. Jul 07 10:37:08.057435 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ded4c735-0514-49d5-8e7f-ec6853325d7a tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Request method failure captured: Jul 07 10:37:08.057435 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: request: DELETE /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e HTTP/1.1 Jul 07 10:37:08.057435 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept: application/json Jul 07 10:37:08.057435 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jul 07 10:37:08.057435 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Connection: close Jul 07 10:37:08.057435 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jul 07 10:37:08.057435 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jul 07 10:37:08.057435 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Host: 10.222.0.16 Jul 07 10:37:08.057435 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jul 07 10:37:08.057435 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jul 07 10:37:08.057435 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABixrY8OvCBMJnjRdOGiniYdWVQXRU5j_oL_-3IW8B050mI9iTiMiAqckVcFrYUNMDNBzu5A7KjWAw4CfsePxF_lhVKdStuWP73EE48s908WgfQ_p-BUvui7Lff6JDUFqsZcmbVchhpCEcFgE514wUYqWgw2aG015Cpl2jakkhdOE3Gcxc Jul 07 10:37:08.057435 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jul 07 10:37:08.057435 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jul 07 10:37:08.057435 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jul 07 10:37:08.057435 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jul 07 10:37:08.057435 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jul 07 10:37:08.057435 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jul 07 10:37:08.057435 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Id: 1568d5b1c4bb471f9de53f4d5cf7cc82 Jul 07 10:37:08.057435 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:37:08.057435 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jul 07 10:37:08.057435 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jul 07 10:37:08.059089 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:37:08.059089 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:37:08.059089 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 1568d5b1c4bb471f9de53f4d5cf7cc82 Jul 07 10:37:08.059089 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:37:08.059089 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User: tempest-AttachVolumeNegativeTest-1710795981-project Jul 07 10:37:08.059089 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jul 07 10:37:08.059089 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jul 07 10:37:08.059089 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Id: 1222d8bb50554d64ac674f109b6ad077 Jul 07 10:37:08.059089 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-AttachVolumeNegativeTest-1710795981-project Jul 07 10:37:08.059089 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: method: > Jul 07 10:37:08.059089 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: exception: Instance b25327c6-c3ad-44eb-90ef-3ab8e86c426e could not be found. Jul 07 10:37:08.059089 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: action_args: {'id': 'b25327c6-c3ad-44eb-90ef-3ab8e86c426e'} Jul 07 10:37:08.060066 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:37:08.060066 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:08.060066 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:37:08.060066 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:37:08.060066 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:37:08.060066 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:37:08.060066 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:37:08.060066 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:37:08.060066 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:37:08.060066 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:37:08.060066 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b25327c6-c3ad-44eb-90ef-3ab8e86c426e could not be found. Jul 07 10:37:08.060066 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:08.060066 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:37:08.060066 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:08.060066 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:08.060066 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:37:08.060066 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:37:08.060066 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:37:08.060066 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:37:08.060066 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:37:08.061644 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:37:08.061644 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 10:37:08.061644 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 10:37:08.061644 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 10:37:08.061644 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 10:37:08.061644 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:37:08.061644 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:37:08.061644 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:37:08.061644 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:37:08.061644 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b25327c6-c3ad-44eb-90ef-3ab8e86c426e could not be found. Jul 07 10:37:08.061644 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:08.061644 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:37:08.061644 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:08.061644 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:08.061644 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:37:08.061644 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:37:08.061644 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:37:08.061644 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:37:08.061644 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b25327c6-c3ad-44eb-90ef-3ab8e86c426e could not be found. Jul 07 10:37:08.061644 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:08.063189 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ded4c735-0514-49d5-8e7f-ec6853325d7a tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Returning 404 to user: Instance b25327c6-c3ad-44eb-90ef-3ab8e86c426e could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:37:08.063189 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ded4c735-0514-49d5-8e7f-ec6853325d7a tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e" status: 404 len: 111 microversion: 2.1 time: 0.029737 Jul 07 10:37:08.063189 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 497/1011] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jul 7 10:37:08 2022] DELETE /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:37:08.067387 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-d7c6be4d-6492-491c-aa13-b7d2e73caad4 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:08.068095 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-d7c6be4d-6492-491c-aa13-b7d2e73caad4 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: b25327c6-c3ad-44eb-90ef-3ab8e86c426e] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:37:08.074919 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d7c6be4d-6492-491c-aa13-b7d2e73caad4 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:08.075370 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d7c6be4d-6492-491c-aa13-b7d2e73caad4 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:08.076152 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d7c6be4d-6492-491c-aa13-b7d2e73caad4 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:08.076587 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-d7c6be4d-6492-491c-aa13-b7d2e73caad4 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:08.089533 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.wsgi [None req-d7c6be4d-6492-491c-aa13-b7d2e73caad4 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] HTTP exception thrown: Instance b25327c6-c3ad-44eb-90ef-3ab8e86c426e could not be found. Jul 07 10:37:08.091035 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-d7c6be4d-6492-491c-aa13-b7d2e73caad4 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Request method failure captured: Jul 07 10:37:08.091035 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e HTTP/1.1 Jul 07 10:37:08.091035 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:37:08.091035 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:37:08.091035 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:37:08.091035 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 0 Jul 07 10:37:08.091035 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:37:08.091035 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:37:08.091035 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:37:08.091035 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:37:08.091035 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrY8OvCBMJnjRdOGiniYdWVQXRU5j_oL_-3IW8B050mI9iTiMiAqckVcFrYUNMDNBzu5A7KjWAw4CfsePxF_lhVKdStuWP73EE48s908WgfQ_p-BUvui7Lff6JDUFqsZcmbVchhpCEcFgE514wUYqWgw2aG015Cpl2jakkhdOE3Gcxc Jul 07 10:37:08.091035 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:37:08.091035 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:37:08.091035 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:37:08.091035 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:37:08.091035 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:37:08.091035 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:37:08.091035 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: 1568d5b1c4bb471f9de53f4d5cf7cc82 Jul 07 10:37:08.091035 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:37:08.091035 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:37:08.091035 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:37:08.092664 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:37:08.092664 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:37:08.092664 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: 1568d5b1c4bb471f9de53f4d5cf7cc82 Jul 07 10:37:08.092664 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:37:08.092664 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-AttachVolumeNegativeTest-1710795981-project Jul 07 10:37:08.092664 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:37:08.092664 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:37:08.092664 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: 1222d8bb50554d64ac674f109b6ad077 Jul 07 10:37:08.092664 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-AttachVolumeNegativeTest-1710795981-project Jul 07 10:37:08.092664 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: > Jul 07 10:37:08.092664 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Instance b25327c6-c3ad-44eb-90ef-3ab8e86c426e could not be found. Jul 07 10:37:08.092664 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'id': 'b25327c6-c3ad-44eb-90ef-3ab8e86c426e'} Jul 07 10:37:08.093643 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:37:08.093643 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:08.093643 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:37:08.093643 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:37:08.093643 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:37:08.093643 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:37:08.093643 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:37:08.093643 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:37:08.093643 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:37:08.093643 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:37:08.093643 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b25327c6-c3ad-44eb-90ef-3ab8e86c426e could not be found. Jul 07 10:37:08.093643 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:08.093643 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:37:08.093643 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:08.093643 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:08.093643 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:37:08.093643 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:37:08.093643 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:37:08.093643 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:37:08.093643 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:37:08.095179 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:37:08.095179 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:37:08.095179 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:37:08.095179 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:37:08.095179 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:37:08.095179 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:37:08.095179 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:37:08.095179 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b25327c6-c3ad-44eb-90ef-3ab8e86c426e could not be found. Jul 07 10:37:08.095179 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:08.095179 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:37:08.095179 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:08.095179 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:08.095179 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:37:08.095179 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:37:08.095179 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:37:08.095179 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:37:08.095179 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b25327c6-c3ad-44eb-90ef-3ab8e86c426e could not be found. Jul 07 10:37:08.095179 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:08.096619 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-d7c6be4d-6492-491c-aa13-b7d2e73caad4 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Returning 404 to user: Instance b25327c6-c3ad-44eb-90ef-3ab8e86c426e could not be found. {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:37:08.096619 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-d7c6be4d-6492-491c-aa13-b7d2e73caad4 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e" status: 404 len: 111 microversion: 2.1 time: 0.029227 Jul 07 10:37:08.096619 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 515/1012] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:37:08 2022] GET /compute/v2.1/servers/b25327c6-c3ad-44eb-90ef-3ab8e86c426e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:37:08.100687 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5ee53535-c1b4-43b6-87dd-dbe037021a59 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:08.101184 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5ee53535-c1b4-43b6-87dd-dbe037021a59 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:37:08.107064 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5ee53535-c1b4-43b6-87dd-dbe037021a59 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:08.107513 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5ee53535-c1b4-43b6-87dd-dbe037021a59 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:08.108297 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5ee53535-c1b4-43b6-87dd-dbe037021a59 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:08.108730 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5ee53535-c1b4-43b6-87dd-dbe037021a59 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:08.122391 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-5ee53535-c1b4-43b6-87dd-dbe037021a59 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] HTTP exception thrown: Instance d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f could not be found. Jul 07 10:37:08.123923 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5ee53535-c1b4-43b6-87dd-dbe037021a59 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Request method failure captured: Jul 07 10:37:08.123923 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: request: DELETE /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f HTTP/1.1 Jul 07 10:37:08.123923 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept: application/json Jul 07 10:37:08.123923 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jul 07 10:37:08.123923 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Connection: close Jul 07 10:37:08.123923 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jul 07 10:37:08.123923 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jul 07 10:37:08.123923 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Host: 10.222.0.16 Jul 07 10:37:08.123923 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jul 07 10:37:08.123923 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jul 07 10:37:08.123923 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABixrY8OvCBMJnjRdOGiniYdWVQXRU5j_oL_-3IW8B050mI9iTiMiAqckVcFrYUNMDNBzu5A7KjWAw4CfsePxF_lhVKdStuWP73EE48s908WgfQ_p-BUvui7Lff6JDUFqsZcmbVchhpCEcFgE514wUYqWgw2aG015Cpl2jakkhdOE3Gcxc Jul 07 10:37:08.123923 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jul 07 10:37:08.123923 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jul 07 10:37:08.123923 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jul 07 10:37:08.123923 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jul 07 10:37:08.123923 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jul 07 10:37:08.123923 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jul 07 10:37:08.123923 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Id: 1568d5b1c4bb471f9de53f4d5cf7cc82 Jul 07 10:37:08.123923 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:37:08.123923 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jul 07 10:37:08.123923 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jul 07 10:37:08.125453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:37:08.125453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:37:08.125453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 1568d5b1c4bb471f9de53f4d5cf7cc82 Jul 07 10:37:08.125453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:37:08.125453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User: tempest-AttachVolumeNegativeTest-1710795981-project Jul 07 10:37:08.125453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jul 07 10:37:08.125453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jul 07 10:37:08.125453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Id: 1222d8bb50554d64ac674f109b6ad077 Jul 07 10:37:08.125453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-AttachVolumeNegativeTest-1710795981-project Jul 07 10:37:08.125453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: method: > Jul 07 10:37:08.125453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: exception: Instance d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f could not be found. Jul 07 10:37:08.125453 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: action_args: {'id': 'd5937bd8-b378-4d9a-b96b-14e1d7d3cb6f'} Jul 07 10:37:08.126493 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:37:08.126493 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:08.126493 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:37:08.126493 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:37:08.126493 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:37:08.126493 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:37:08.126493 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:37:08.126493 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:37:08.126493 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:37:08.126493 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:37:08.126493 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f could not be found. Jul 07 10:37:08.126493 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:08.126493 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:37:08.126493 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:08.126493 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:08.126493 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:37:08.126493 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:37:08.126493 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:37:08.126493 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:37:08.126493 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:37:08.128108 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:37:08.128108 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 10:37:08.128108 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 10:37:08.128108 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 10:37:08.128108 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 10:37:08.128108 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:37:08.128108 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:37:08.128108 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:37:08.128108 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:37:08.128108 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f could not be found. Jul 07 10:37:08.128108 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:08.128108 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:37:08.128108 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:08.128108 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:08.128108 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:37:08.128108 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:37:08.128108 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:37:08.128108 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:37:08.128108 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f could not be found. Jul 07 10:37:08.128108 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:08.129603 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5ee53535-c1b4-43b6-87dd-dbe037021a59 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Returning 404 to user: Instance d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:37:08.129603 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5ee53535-c1b4-43b6-87dd-dbe037021a59 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f" status: 404 len: 111 microversion: 2.1 time: 0.028389 Jul 07 10:37:08.129603 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 498/1013] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jul 7 10:37:08 2022] DELETE /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:37:08.133952 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-b6b03874-b86f-4590-8040-c9a22a40bea9 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:08.134559 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-b6b03874-b86f-4590-8040-c9a22a40bea9 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:37:08.140423 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b6b03874-b86f-4590-8040-c9a22a40bea9 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:08.140871 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b6b03874-b86f-4590-8040-c9a22a40bea9 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:08.141630 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b6b03874-b86f-4590-8040-c9a22a40bea9 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:08.142060 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-b6b03874-b86f-4590-8040-c9a22a40bea9 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:08.155039 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.wsgi [None req-b6b03874-b86f-4590-8040-c9a22a40bea9 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] HTTP exception thrown: Instance d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f could not be found. Jul 07 10:37:08.156562 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-b6b03874-b86f-4590-8040-c9a22a40bea9 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Request method failure captured: Jul 07 10:37:08.156562 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f HTTP/1.1 Jul 07 10:37:08.156562 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:37:08.156562 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:37:08.156562 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:37:08.156562 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 0 Jul 07 10:37:08.156562 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:37:08.156562 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:37:08.156562 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:37:08.156562 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:37:08.156562 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrY8OvCBMJnjRdOGiniYdWVQXRU5j_oL_-3IW8B050mI9iTiMiAqckVcFrYUNMDNBzu5A7KjWAw4CfsePxF_lhVKdStuWP73EE48s908WgfQ_p-BUvui7Lff6JDUFqsZcmbVchhpCEcFgE514wUYqWgw2aG015Cpl2jakkhdOE3Gcxc Jul 07 10:37:08.156562 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:37:08.156562 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:37:08.156562 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:37:08.156562 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:37:08.156562 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:37:08.156562 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:37:08.156562 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: 1568d5b1c4bb471f9de53f4d5cf7cc82 Jul 07 10:37:08.156562 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:37:08.156562 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:37:08.156562 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:37:08.158127 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:37:08.158127 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:37:08.158127 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: 1568d5b1c4bb471f9de53f4d5cf7cc82 Jul 07 10:37:08.158127 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:37:08.158127 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-AttachVolumeNegativeTest-1710795981-project Jul 07 10:37:08.158127 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:37:08.158127 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:37:08.158127 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: 1222d8bb50554d64ac674f109b6ad077 Jul 07 10:37:08.158127 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-AttachVolumeNegativeTest-1710795981-project Jul 07 10:37:08.158127 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: > Jul 07 10:37:08.158127 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Instance d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f could not be found. Jul 07 10:37:08.158127 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'id': 'd5937bd8-b378-4d9a-b96b-14e1d7d3cb6f'} Jul 07 10:37:08.159011 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:37:08.159011 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:08.159011 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:37:08.159011 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:37:08.159011 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:37:08.159011 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:37:08.159011 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:37:08.159011 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:37:08.159011 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:37:08.159011 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:37:08.159011 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f could not be found. Jul 07 10:37:08.159011 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:08.159011 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:37:08.159011 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:08.159011 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:08.159011 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:37:08.159011 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:37:08.159011 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:37:08.159011 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:37:08.159011 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:37:08.160609 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:37:08.160609 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:37:08.160609 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:37:08.160609 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:37:08.160609 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:37:08.160609 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:37:08.160609 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:37:08.160609 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f could not be found. Jul 07 10:37:08.160609 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:08.160609 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:37:08.160609 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:08.160609 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:08.160609 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:37:08.160609 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:37:08.160609 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:37:08.160609 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:37:08.160609 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f could not be found. Jul 07 10:37:08.160609 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:08.162419 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-b6b03874-b86f-4590-8040-c9a22a40bea9 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Returning 404 to user: Instance d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f could not be found. {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:37:08.162419 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-b6b03874-b86f-4590-8040-c9a22a40bea9 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f" status: 404 len: 111 microversion: 2.1 time: 0.028276 Jul 07 10:37:08.162419 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 516/1014] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:37:08 2022] GET /compute/v2.1/servers/d5937bd8-b378-4d9a-b96b-14e1d7d3cb6f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:37:09.289046 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6610359d-b252-4b80-a566-f4c9e175f451 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:09.289547 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6610359d-b252-4b80-a566-f4c9e175f451 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:37:09.295990 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6610359d-b252-4b80-a566-f4c9e175f451 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:09.296448 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6610359d-b252-4b80-a566-f4c9e175f451 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:09.297211 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6610359d-b252-4b80-a566-f4c9e175f451 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:09.297648 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6610359d-b252-4b80-a566-f4c9e175f451 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:09.310820 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-6610359d-b252-4b80-a566-f4c9e175f451 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] HTTP exception thrown: Instance 55b0ddaa-4b4a-4050-a95f-dea6e7754d12 could not be found. Jul 07 10:37:09.312388 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6610359d-b252-4b80-a566-f4c9e175f451 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Request method failure captured: Jul 07 10:37:09.312388 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: request: DELETE /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12 HTTP/1.1 Jul 07 10:37:09.312388 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept: application/json Jul 07 10:37:09.312388 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jul 07 10:37:09.312388 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Connection: close Jul 07 10:37:09.312388 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jul 07 10:37:09.312388 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jul 07 10:37:09.312388 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Host: 10.222.0.16 Jul 07 10:37:09.312388 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jul 07 10:37:09.312388 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jul 07 10:37:09.312388 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABixrY8OvCBMJnjRdOGiniYdWVQXRU5j_oL_-3IW8B050mI9iTiMiAqckVcFrYUNMDNBzu5A7KjWAw4CfsePxF_lhVKdStuWP73EE48s908WgfQ_p-BUvui7Lff6JDUFqsZcmbVchhpCEcFgE514wUYqWgw2aG015Cpl2jakkhdOE3Gcxc Jul 07 10:37:09.312388 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jul 07 10:37:09.312388 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jul 07 10:37:09.312388 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jul 07 10:37:09.312388 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jul 07 10:37:09.312388 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jul 07 10:37:09.312388 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jul 07 10:37:09.312388 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Id: 1568d5b1c4bb471f9de53f4d5cf7cc82 Jul 07 10:37:09.312388 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:37:09.312388 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jul 07 10:37:09.312388 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jul 07 10:37:09.314031 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:37:09.314031 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:37:09.314031 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 1568d5b1c4bb471f9de53f4d5cf7cc82 Jul 07 10:37:09.314031 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:37:09.314031 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User: tempest-AttachVolumeNegativeTest-1710795981-project Jul 07 10:37:09.314031 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jul 07 10:37:09.314031 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jul 07 10:37:09.314031 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Id: 1222d8bb50554d64ac674f109b6ad077 Jul 07 10:37:09.314031 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-AttachVolumeNegativeTest-1710795981-project Jul 07 10:37:09.314031 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: method: > Jul 07 10:37:09.314031 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: exception: Instance 55b0ddaa-4b4a-4050-a95f-dea6e7754d12 could not be found. Jul 07 10:37:09.314031 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: action_args: {'id': '55b0ddaa-4b4a-4050-a95f-dea6e7754d12'} Jul 07 10:37:09.314988 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:37:09.314988 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:09.314988 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:37:09.314988 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:37:09.314988 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:37:09.314988 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:37:09.314988 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:37:09.314988 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:37:09.314988 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:37:09.314988 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:37:09.314988 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55b0ddaa-4b4a-4050-a95f-dea6e7754d12 could not be found. Jul 07 10:37:09.314988 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:09.314988 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:37:09.314988 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:09.314988 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:09.314988 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:37:09.314988 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:37:09.314988 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:37:09.314988 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:37:09.314988 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:37:09.316787 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:37:09.316787 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 10:37:09.316787 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 10:37:09.316787 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 10:37:09.316787 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 10:37:09.316787 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:37:09.316787 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:37:09.316787 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:37:09.316787 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:37:09.316787 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55b0ddaa-4b4a-4050-a95f-dea6e7754d12 could not be found. Jul 07 10:37:09.316787 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:09.316787 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:37:09.316787 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:09.316787 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:09.316787 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:37:09.316787 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:37:09.316787 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:37:09.316787 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:37:09.316787 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55b0ddaa-4b4a-4050-a95f-dea6e7754d12 could not be found. Jul 07 10:37:09.316787 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:09.318309 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6610359d-b252-4b80-a566-f4c9e175f451 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Returning 404 to user: Instance 55b0ddaa-4b4a-4050-a95f-dea6e7754d12 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:37:09.318309 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6610359d-b252-4b80-a566-f4c9e175f451 tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "DELETE /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12" status: 404 len: 111 microversion: 2.1 time: 0.029265 Jul 07 10:37:09.318309 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 499/1015] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jul 7 10:37:09 2022] DELETE /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:37:09.326478 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-fafb436d-bd40-41c9-8532-8d34f5c647fd tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Calling method '>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:09.327139 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.compute.api [None req-fafb436d-bd40-41c9-8532-8d34f5c647fd tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] [instance: 55b0ddaa-4b4a-4050-a95f-dea6e7754d12] Fetching instance by UUID {{(pid=117646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 10:37:09.334059 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fafb436d-bd40-41c9-8532-8d34f5c647fd tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:09.334524 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fafb436d-bd40-41c9-8532-8d34f5c647fd tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:09.335333 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fafb436d-bd40-41c9-8532-8d34f5c647fd tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 10:37:09.335802 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG oslo_concurrency.lockutils [None req-fafb436d-bd40-41c9-8532-8d34f5c647fd tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Lock "fd84c606-f924-4671-b7db-795cc76f382d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 10:37:09.348918 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.wsgi [None req-fafb436d-bd40-41c9-8532-8d34f5c647fd tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] HTTP exception thrown: Instance 55b0ddaa-4b4a-4050-a95f-dea6e7754d12 could not be found. Jul 07 10:37:09.351055 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-fafb436d-bd40-41c9-8532-8d34f5c647fd tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Request method failure captured: Jul 07 10:37:09.351055 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12 HTTP/1.1 Jul 07 10:37:09.351055 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:37:09.351055 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:37:09.351055 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:37:09.351055 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 0 Jul 07 10:37:09.351055 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:37:09.351055 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:37:09.351055 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:37:09.351055 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:37:09.351055 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrY8OvCBMJnjRdOGiniYdWVQXRU5j_oL_-3IW8B050mI9iTiMiAqckVcFrYUNMDNBzu5A7KjWAw4CfsePxF_lhVKdStuWP73EE48s908WgfQ_p-BUvui7Lff6JDUFqsZcmbVchhpCEcFgE514wUYqWgw2aG015Cpl2jakkhdOE3Gcxc Jul 07 10:37:09.351055 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:37:09.351055 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:37:09.351055 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:37:09.351055 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:37:09.351055 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:37:09.351055 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:37:09.351055 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: 1568d5b1c4bb471f9de53f4d5cf7cc82 Jul 07 10:37:09.351055 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:37:09.351055 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:37:09.351055 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:37:09.352688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1568d5b1c4bb471f9de53f4d5cf7cc82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:37:09.352688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:37:09.352688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: 1568d5b1c4bb471f9de53f4d5cf7cc82 Jul 07 10:37:09.352688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1710795981 Jul 07 10:37:09.352688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-AttachVolumeNegativeTest-1710795981-project Jul 07 10:37:09.352688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:37:09.352688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:37:09.352688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: 1222d8bb50554d64ac674f109b6ad077 Jul 07 10:37:09.352688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-AttachVolumeNegativeTest-1710795981-project Jul 07 10:37:09.352688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: > Jul 07 10:37:09.352688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Instance 55b0ddaa-4b4a-4050-a95f-dea6e7754d12 could not be found. Jul 07 10:37:09.352688 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'id': '55b0ddaa-4b4a-4050-a95f-dea6e7754d12'} Jul 07 10:37:09.353663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:37:09.353663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:09.353663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 10:37:09.353663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 10:37:09.353663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 10:37:09.353663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 10:37:09.353663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 10:37:09.353663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 10:37:09.353663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 10:37:09.353663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 10:37:09.353663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55b0ddaa-4b4a-4050-a95f-dea6e7754d12 could not be found. Jul 07 10:37:09.353663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:09.353663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:37:09.353663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:09.353663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:09.353663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:37:09.353663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:37:09.353663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:37:09.353663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:37:09.353663 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:37:09.355209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:37:09.355209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 10:37:09.355209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 10:37:09.355209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 10:37:09.355209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 10:37:09.355209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 10:37:09.355209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:37:09.355209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55b0ddaa-4b4a-4050-a95f-dea6e7754d12 could not be found. Jul 07 10:37:09.355209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:09.355209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:37:09.355209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:09.355209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:09.355209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:37:09.355209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:37:09.355209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:37:09.355209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:37:09.355209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55b0ddaa-4b4a-4050-a95f-dea6e7754d12 could not be found. Jul 07 10:37:09.355209 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:09.356554 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-fafb436d-bd40-41c9-8532-8d34f5c647fd tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] Returning 404 to user: Instance 55b0ddaa-4b4a-4050-a95f-dea6e7754d12 could not be found. {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:37:09.356554 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-fafb436d-bd40-41c9-8532-8d34f5c647fd tempest-AttachVolumeNegativeTest-1710795981 tempest-AttachVolumeNegativeTest-1710795981-project] 10.222.0.16 "GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12" status: 404 len: 111 microversion: 2.1 time: 0.029872 Jul 07 10:37:09.356554 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 517/1016] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jul 7 10:37:09 2022] GET /compute/v2.1/servers/55b0ddaa-4b4a-4050-a95f-dea6e7754d12 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:37:13.641497 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-dc5a6224-0410-4086-849d-ab291ec8962b tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] Action: 'create', calling method: .version_select at 0x7f9e9e4cd8b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-723260480"}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:37:13.940268 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-dc5a6224-0410-4086-849d-ab291ec8962b tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.407942 Jul 07 10:37:13.941158 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 500/1017] 10.222.0.16 () {60 vars in 1154 bytes} [Thu Jul 7 10:37:13 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 410 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 07 10:37:13.952363 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-1c5115e0-ae4e-45e4-98df-942dc754bc02 tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] Calling method '.version_select at 0x7f9e9e446c10>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:14.002666 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-1c5115e0-ae4e-45e4-98df-942dc754bc02 tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3" status: 200 len: 344 microversion: 2.1 time: 0.053946 Jul 07 10:37:14.003352 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 518/1018] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jul 7 10:37:13 2022] GET /compute/v2.1/os-volumes/4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:37:15.016100 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1b48ed8d-18c4-4ace-aa96-49a9ccf3ef24 tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] Calling method '.version_select at 0x7f9e9e303ca0>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:15.062063 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1b48ed8d-18c4-4ace-aa96-49a9ccf3ef24 tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3" status: 200 len: 345 microversion: 2.1 time: 0.050296 Jul 07 10:37:15.062628 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 501/1019] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jul 7 10:37:15 2022] GET /compute/v2.1/os-volumes/4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:37:15.074446 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-25eb5f71-2833-48ec-ad0a-cf760cd9f57d tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] Action: 'create', calling method: .version_select at 0x7f9e9e518f70>, body: {"snapshot": {"volume_id": "4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1769527390"}} {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 10:37:15.220849 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-25eb5f71-2833-48ec-ad0a-cf760cd9f57d tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.150905 Jul 07 10:37:15.221425 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 519/1020] 10.222.0.16 () {60 vars in 1161 bytes} [Thu Jul 7 10:37:15 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:37:15.231565 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6d6fd40c-60a8-4abd-8344-5c110144d358 tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] Calling method '.version_select at 0x7f9e9e560f70>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:15.261191 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6d6fd40c-60a8-4abd-8344-5c110144d358 tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/38ed3262-a7f9-4c52-a812-0650a26fd856" status: 200 len: 287 microversion: 2.1 time: 0.033187 Jul 07 10:37:15.261749 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 502/1021] 10.222.0.16 () {58 vars in 1250 bytes} [Thu Jul 7 10:37:15 2022] GET /compute/v2.1/os-snapshots/38ed3262-a7f9-4c52-a812-0650a26fd856 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:37:15.272619 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-c8f5b221-dbb8-4032-889b-045cc6609696 tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] Calling method '.version_select at 0x7f9e9e3dd820>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:15.301449 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-c8f5b221-dbb8-4032-889b-045cc6609696 tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.033688 Jul 07 10:37:15.302011 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 520/1022] 10.222.0.16 () {58 vars in 1139 bytes} [Thu Jul 7 10:37:15 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:37:15.311972 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-20a555b8-5e74-4c70-864b-5796e9f4da9e tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] Calling method '.version_select at 0x7f9ea0c26160>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:15.340980 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-20a555b8-5e74-4c70-864b-5796e9f4da9e tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/38ed3262-a7f9-4c52-a812-0650a26fd856" status: 200 len: 287 microversion: 2.1 time: 0.032827 Jul 07 10:37:15.341545 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 503/1023] 10.222.0.16 () {58 vars in 1250 bytes} [Thu Jul 7 10:37:15 2022] GET /compute/v2.1/os-snapshots/38ed3262-a7f9-4c52-a812-0650a26fd856 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:37:16.353130 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-69d39d85-d562-47f0-bf47-123768060c42 tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] Calling method '.version_select at 0x7f9e9e4cbe50>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:16.384367 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-69d39d85-d562-47f0-bf47-123768060c42 tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/38ed3262-a7f9-4c52-a812-0650a26fd856" status: 200 len: 287 microversion: 2.1 time: 0.035391 Jul 07 10:37:16.384936 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 521/1024] 10.222.0.16 () {58 vars in 1250 bytes} [Thu Jul 7 10:37:16 2022] GET /compute/v2.1/os-snapshots/38ed3262-a7f9-4c52-a812-0650a26fd856 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:37:17.397259 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c218d38c-30c3-4c40-8c2b-e2f4ceb53f1c tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] Calling method '.version_select at 0x7f9e9e6a3310>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:17.426817 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c218d38c-30c3-4c40-8c2b-e2f4ceb53f1c tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/38ed3262-a7f9-4c52-a812-0650a26fd856" status: 200 len: 287 microversion: 2.1 time: 0.034301 Jul 07 10:37:17.427393 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 504/1025] 10.222.0.16 () {58 vars in 1250 bytes} [Thu Jul 7 10:37:17 2022] GET /compute/v2.1/os-snapshots/38ed3262-a7f9-4c52-a812-0650a26fd856 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:37:18.439148 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-d2dc49a0-efa8-4cd3-a3bc-ae20ff1776f4 tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] Calling method '.version_select at 0x7f9e9e5183a0>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:18.471925 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-d2dc49a0-efa8-4cd3-a3bc-ae20ff1776f4 tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/38ed3262-a7f9-4c52-a812-0650a26fd856" status: 200 len: 288 microversion: 2.1 time: 0.037138 Jul 07 10:37:18.472435 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 522/1026] 10.222.0.16 () {58 vars in 1250 bytes} [Thu Jul 7 10:37:18 2022] GET /compute/v2.1/os-snapshots/38ed3262-a7f9-4c52-a812-0650a26fd856 => generated 288 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:37:18.484745 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8f1caff7-bfd1-4b1c-adee-f9fe14ccd0ec tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] Calling method '.version_select at 0x7f9e9e4cd310>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:18.547369 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8f1caff7-bfd1-4b1c-adee-f9fe14ccd0ec tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/38ed3262-a7f9-4c52-a812-0650a26fd856" status: 202 len: 0 microversion: 2.1 time: 0.066936 Jul 07 10:37:18.548040 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 505/1027] 10.222.0.16 () {58 vars in 1253 bytes} [Thu Jul 7 10:37:18 2022] DELETE /compute/v2.1/os-snapshots/38ed3262-a7f9-4c52-a812-0650a26fd856 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 10:37:18.556535 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-05ddc39d-29e8-4264-9d3a-82c3150a9aeb tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] Calling method '.version_select at 0x7f9e9e365040>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:18.586725 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-05ddc39d-29e8-4264-9d3a-82c3150a9aeb tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/38ed3262-a7f9-4c52-a812-0650a26fd856" status: 200 len: 287 microversion: 2.1 time: 0.034320 Jul 07 10:37:18.587293 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 523/1028] 10.222.0.16 () {58 vars in 1250 bytes} [Thu Jul 7 10:37:18 2022] GET /compute/v2.1/os-snapshots/38ed3262-a7f9-4c52-a812-0650a26fd856 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:37:19.595471 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=11 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:37:19.596277 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=15 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:37:19.601441 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e5e2fa0e-ec03-4470-b8ce-6d3ed842b1ee tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] Calling method '.version_select at 0x7f9e9e303550>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:19.627068 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-e5e2fa0e-ec03-4470-b8ce-6d3ed842b1ee tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] HTTP exception thrown: Snapshot 38ed3262-a7f9-4c52-a812-0650a26fd856 could not be found. Jul 07 10:37:19.629354 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e5e2fa0e-ec03-4470-b8ce-6d3ed842b1ee tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] Request method failure captured: Jul 07 10:37:19.629354 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/os-snapshots/38ed3262-a7f9-4c52-a812-0650a26fd856 HTTP/1.1 Jul 07 10:37:19.629354 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept: application/json Jul 07 10:37:19.629354 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jul 07 10:37:19.629354 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Connection: close Jul 07 10:37:19.629354 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jul 07 10:37:19.629354 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jul 07 10:37:19.629354 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Host: 10.222.0.16 Jul 07 10:37:19.629354 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jul 07 10:37:19.629354 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jul 07 10:37:19.629354 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABixrdZIUKuk2SsaJG9VygjGqTYLffbXpXQs-37tK_fdSkNMC2VblqFm7PO8it1cZ-GxruqXZSt8WaMq5abI_wfUTzdfE4fHazsL_a3UMJjPVLfmeEfNiGiBCBWRXiHVsdmbi3tTu_44DXfWpZFMAgrceD71NabuSn93sQPfK68X237EO0 Jul 07 10:37:19.629354 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jul 07 10:37:19.629354 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jul 07 10:37:19.629354 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jul 07 10:37:19.629354 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jul 07 10:37:19.629354 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jul 07 10:37:19.629354 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jul 07 10:37:19.629354 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Id: d81879d0f849442e9f54936c7afb26a2 Jul 07 10:37:19.629354 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-174396199 Jul 07 10:37:19.629354 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jul 07 10:37:19.629354 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jul 07 10:37:19.630993 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d81879d0f849442e9f54936c7afb26a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d81879d0f849442e9f54936c7afb26a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d81879d0f849442e9f54936c7afb26a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d81879d0f849442e9f54936c7afb26a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:37:19.630993 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-VolumesSnapshotsTestJSON-174396199 Jul 07 10:37:19.630993 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Id: d81879d0f849442e9f54936c7afb26a2 Jul 07 10:37:19.630993 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-174396199 Jul 07 10:37:19.630993 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User: tempest-VolumesSnapshotsTestJSON-174396199-project Jul 07 10:37:19.630993 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jul 07 10:37:19.630993 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jul 07 10:37:19.630993 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Id: dfe0c5a416d94ceca62f5bb1f4bdfddf Jul 07 10:37:19.630993 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-VolumesSnapshotsTestJSON-174396199-project Jul 07 10:37:19.630993 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: method: Jul 07 10:37:19.630993 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: exception: Snapshot 38ed3262-a7f9-4c52-a812-0650a26fd856 could not be found. Jul 07 10:37:19.630993 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: action_args: {'id': '38ed3262-a7f9-4c52-a812-0650a26fd856'} Jul 07 10:37:19.630993 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:37:19.631980 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:19.631980 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 07 10:37:19.631980 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 07 10:37:19.631980 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 07 10:37:19.631980 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 07 10:37:19.631980 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 07 10:37:19.631980 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 07 10:37:19.631980 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 10:37:19.631980 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 10:37:19.631980 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 10:37:19.631980 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 10:37:19.631980 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 10:37:19.631980 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 10:37:19.631980 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 10:37:19.631980 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 10:37:19.631980 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 38ed3262-a7f9-4c52-a812-0650a26fd856 could not be found. (HTTP 404) (Request-ID: req-56203f2a-9016-442c-91f8-55332ea2a610) Jul 07 10:37:19.631980 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:19.631980 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:37:19.633303 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:19.633303 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:19.633303 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 07 10:37:19.633303 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 07 10:37:19.633303 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 10:37:19.633303 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 10:37:19.633303 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 07 10:37:19.633303 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 07 10:37:19.633303 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 10:37:19.633303 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 10:37:19.633303 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 07 10:37:19.633303 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 07 10:37:19.633303 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 07 10:37:19.633303 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 07 10:37:19.633303 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 07 10:37:19.633303 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 07 10:37:19.633303 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 10:37:19.633303 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 10:37:19.633303 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 10:37:19.634706 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 10:37:19.634706 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 10:37:19.634706 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 10:37:19.634706 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 10:37:19.634706 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 10:37:19.634706 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 38ed3262-a7f9-4c52-a812-0650a26fd856 could not be found. Jul 07 10:37:19.634706 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:19.634706 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:37:19.634706 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:19.634706 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:19.634706 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:37:19.634706 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:37:19.634706 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:37:19.634706 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:37:19.634706 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 10:37:19.634706 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 10:37:19.634706 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:37:19.634706 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:37:19.634706 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 07 10:37:19.634706 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:37:19.636201 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 38ed3262-a7f9-4c52-a812-0650a26fd856 could not be found. Jul 07 10:37:19.636201 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:19.636201 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:37:19.636201 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:19.636201 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:19.636201 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:37:19.636201 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:37:19.636201 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:37:19.636201 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:37:19.636201 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 38ed3262-a7f9-4c52-a812-0650a26fd856 could not be found. Jul 07 10:37:19.636201 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:19.636201 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e5e2fa0e-ec03-4470-b8ce-6d3ed842b1ee tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] Returning 404 to user: Snapshot 38ed3262-a7f9-4c52-a812-0650a26fd856 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:37:19.636201 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e5e2fa0e-ec03-4470-b8ce-6d3ed842b1ee tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/38ed3262-a7f9-4c52-a812-0650a26fd856" status: 404 len: 111 microversion: 2.1 time: 0.036022 Jul 07 10:37:19.637169 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 506/1029] 10.222.0.16 () {58 vars in 1250 bytes} [Thu Jul 7 10:37:19 2022] GET /compute/v2.1/os-snapshots/38ed3262-a7f9-4c52-a812-0650a26fd856 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:37:19.637256 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:37:19.637256 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG dbcounter [-] [117646] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 10:37:19.641342 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-3d1dca46-7347-4097-9e26-3eec787224d2 tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] Calling method '.version_select at 0x7f9e9e5181f0>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:19.701733 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-3d1dca46-7347-4097-9e26-3eec787224d2 tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3" status: 202 len: 0 microversion: 2.1 time: 0.066066 Jul 07 10:37:19.702307 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 524/1030] 10.222.0.16 () {58 vars in 1247 bytes} [Thu Jul 7 10:37:19 2022] DELETE /compute/v2.1/os-volumes/4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 07 10:37:19.711352 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1992951f-a348-4fd8-9e5a-3726802390cc tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] Calling method '.version_select at 0x7f9e9e4cd8b0>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:19.757584 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1992951f-a348-4fd8-9e5a-3726802390cc tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3" status: 200 len: 344 microversion: 2.1 time: 0.049992 Jul 07 10:37:19.758255 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 507/1031] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jul 7 10:37:19 2022] GET /compute/v2.1/os-volumes/4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:37:20.770928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-5aaed4fb-6288-4a16-a1e7-16f79368f2f7 tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] Calling method '.version_select at 0x7f9e9e617280>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:20.798954 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.wsgi [None req-5aaed4fb-6288-4a16-a1e7-16f79368f2f7 tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] HTTP exception thrown: Volume 4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3 could not be found. Jul 07 10:37:20.800928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-5aaed4fb-6288-4a16-a1e7-16f79368f2f7 tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] Request method failure captured: Jul 07 10:37:20.800928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: GET /compute/v2.1/os-volumes/4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3 HTTP/1.1 Jul 07 10:37:20.800928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:37:20.800928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:37:20.800928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:37:20.800928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 0 Jul 07 10:37:20.800928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:37:20.800928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:37:20.800928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:37:20.800928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:37:20.800928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrdZIUKuk2SsaJG9VygjGqTYLffbXpXQs-37tK_fdSkNMC2VblqFm7PO8it1cZ-GxruqXZSt8WaMq5abI_wfUTzdfE4fHazsL_a3UMJjPVLfmeEfNiGiBCBWRXiHVsdmbi3tTu_44DXfWpZFMAgrceD71NabuSn93sQPfK68X237EO0 Jul 07 10:37:20.800928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:37:20.800928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:37:20.800928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:37:20.800928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:37:20.800928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:37:20.800928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:37:20.800928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: d81879d0f849442e9f54936c7afb26a2 Jul 07 10:37:20.800928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-174396199 Jul 07 10:37:20.800928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:37:20.800928 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:37:20.802558 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d81879d0f849442e9f54936c7afb26a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d81879d0f849442e9f54936c7afb26a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d81879d0f849442e9f54936c7afb26a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d81879d0f849442e9f54936c7afb26a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:37:20.802558 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-VolumesSnapshotsTestJSON-174396199 Jul 07 10:37:20.802558 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: d81879d0f849442e9f54936c7afb26a2 Jul 07 10:37:20.802558 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-174396199 Jul 07 10:37:20.802558 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-VolumesSnapshotsTestJSON-174396199-project Jul 07 10:37:20.802558 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:37:20.802558 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:37:20.802558 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: dfe0c5a416d94ceca62f5bb1f4bdfddf Jul 07 10:37:20.802558 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-VolumesSnapshotsTestJSON-174396199-project Jul 07 10:37:20.802558 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: Jul 07 10:37:20.802558 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Volume 4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3 could not be found. Jul 07 10:37:20.802558 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'id': '4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3'} Jul 07 10:37:20.802558 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:37:20.803491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:20.803491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 10:37:20.803491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 10:37:20.803491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 10:37:20.803491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 10:37:20.803491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 10:37:20.803491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 10:37:20.803491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 10:37:20.803491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 10:37:20.803491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 10:37:20.803491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 10:37:20.803491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 10:37:20.803491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 10:37:20.803491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 10:37:20.803491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 10:37:20.803491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3 could not be found. (HTTP 404) (Request-ID: req-216e9957-4af9-4169-8280-25e3b553b06d) Jul 07 10:37:20.803491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:20.803491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:37:20.803491 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:20.804931 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:20.804931 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 07 10:37:20.804931 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 07 10:37:20.804931 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 10:37:20.804931 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 10:37:20.804931 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 07 10:37:20.804931 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 07 10:37:20.804931 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 10:37:20.804931 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 10:37:20.804931 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 10:37:20.804931 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 10:37:20.804931 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 10:37:20.804931 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 10:37:20.804931 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 10:37:20.804931 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 10:37:20.804931 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 10:37:20.804931 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 10:37:20.804931 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 10:37:20.804931 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 10:37:20.806305 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 10:37:20.806305 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 10:37:20.806305 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 10:37:20.806305 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 10:37:20.806305 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3 could not be found. Jul 07 10:37:20.806305 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:20.806305 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:37:20.806305 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:20.806305 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:20.806305 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:37:20.806305 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:37:20.806305 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:37:20.806305 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:37:20.806305 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 10:37:20.806305 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 10:37:20.806305 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:37:20.806305 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:37:20.806305 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 07 10:37:20.806305 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:37:20.808025 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3 could not be found. Jul 07 10:37:20.808025 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:20.808025 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:37:20.808025 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:20.808025 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:20.808025 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:37:20.808025 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:37:20.808025 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:37:20.808025 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:37:20.808025 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3 could not be found. Jul 07 10:37:20.808025 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:20.808025 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-5aaed4fb-6288-4a16-a1e7-16f79368f2f7 tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] Returning 404 to user: Volume 4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3 could not be found. {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:37:20.808025 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-5aaed4fb-6288-4a16-a1e7-16f79368f2f7 tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3" status: 404 len: 109 microversion: 2.1 time: 0.035895 Jul 07 10:37:20.808025 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 525/1032] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jul 7 10:37:20 2022] GET /compute/v2.1/os-volumes/4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:37:20.813105 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-3146a31a-2341-42f3-912b-f904fc9b4275 tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] Calling method '.version_select at 0x7f9e9e3039d0>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:20.840276 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-3146a31a-2341-42f3-912b-f904fc9b4275 tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] HTTP exception thrown: Volume 4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3 could not be found. Jul 07 10:37:20.842186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-3146a31a-2341-42f3-912b-f904fc9b4275 tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] Request method failure captured: Jul 07 10:37:20.842186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: request: DELETE /compute/v2.1/os-volumes/4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3 HTTP/1.1 Jul 07 10:37:20.842186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept: application/json Jul 07 10:37:20.842186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jul 07 10:37:20.842186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Connection: close Jul 07 10:37:20.842186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jul 07 10:37:20.842186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jul 07 10:37:20.842186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Host: 10.222.0.16 Jul 07 10:37:20.842186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jul 07 10:37:20.842186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jul 07 10:37:20.842186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABixrdZIUKuk2SsaJG9VygjGqTYLffbXpXQs-37tK_fdSkNMC2VblqFm7PO8it1cZ-GxruqXZSt8WaMq5abI_wfUTzdfE4fHazsL_a3UMJjPVLfmeEfNiGiBCBWRXiHVsdmbi3tTu_44DXfWpZFMAgrceD71NabuSn93sQPfK68X237EO0 Jul 07 10:37:20.842186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jul 07 10:37:20.842186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jul 07 10:37:20.842186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jul 07 10:37:20.842186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jul 07 10:37:20.842186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jul 07 10:37:20.842186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jul 07 10:37:20.842186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Id: d81879d0f849442e9f54936c7afb26a2 Jul 07 10:37:20.842186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-174396199 Jul 07 10:37:20.842186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jul 07 10:37:20.842186 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jul 07 10:37:20.843814 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d81879d0f849442e9f54936c7afb26a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d81879d0f849442e9f54936c7afb26a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d81879d0f849442e9f54936c7afb26a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d81879d0f849442e9f54936c7afb26a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:37:20.843814 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-VolumesSnapshotsTestJSON-174396199 Jul 07 10:37:20.843814 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Id: d81879d0f849442e9f54936c7afb26a2 Jul 07 10:37:20.843814 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-174396199 Jul 07 10:37:20.843814 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User: tempest-VolumesSnapshotsTestJSON-174396199-project Jul 07 10:37:20.843814 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jul 07 10:37:20.843814 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jul 07 10:37:20.843814 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Id: dfe0c5a416d94ceca62f5bb1f4bdfddf Jul 07 10:37:20.843814 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-VolumesSnapshotsTestJSON-174396199-project Jul 07 10:37:20.843814 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: method: Jul 07 10:37:20.843814 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: exception: Volume 4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3 could not be found. Jul 07 10:37:20.843814 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: action_args: {'id': '4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3'} Jul 07 10:37:20.843814 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:37:20.844797 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:20.844797 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 10:37:20.844797 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 10:37:20.844797 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 07 10:37:20.844797 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 07 10:37:20.844797 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 07 10:37:20.844797 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 07 10:37:20.844797 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 07 10:37:20.844797 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 07 10:37:20.844797 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 07 10:37:20.844797 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 07 10:37:20.844797 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 10:37:20.844797 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 10:37:20.844797 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 10:37:20.844797 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 10:37:20.844797 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3 could not be found. (HTTP 404) (Request-ID: req-0d32b425-8a56-48f4-b4ce-7ce9fa0fa969) Jul 07 10:37:20.844797 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:20.844797 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:37:20.844797 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:20.846228 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:20.846228 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 07 10:37:20.846228 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 07 10:37:20.846228 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 10:37:20.846228 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 10:37:20.846228 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 07 10:37:20.846228 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 07 10:37:20.846228 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 10:37:20.846228 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 10:37:20.846228 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 10:37:20.846228 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 10:37:20.846228 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 07 10:37:20.846228 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 07 10:37:20.846228 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 07 10:37:20.846228 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 07 10:37:20.846228 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 07 10:37:20.846228 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 07 10:37:20.846228 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 07 10:37:20.846228 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 07 10:37:20.847589 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 10:37:20.847589 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 10:37:20.847589 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 10:37:20.847589 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 10:37:20.847589 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3 could not be found. Jul 07 10:37:20.847589 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:20.847589 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:37:20.847589 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:20.847589 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:20.847589 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:37:20.847589 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:37:20.847589 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:37:20.847589 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:37:20.847589 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 10:37:20.847589 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 10:37:20.847589 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:37:20.847589 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:37:20.847589 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 07 10:37:20.847589 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:37:20.848994 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3 could not be found. Jul 07 10:37:20.848994 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:20.848994 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:37:20.848994 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:20.848994 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:20.848994 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:37:20.848994 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:37:20.848994 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:37:20.848994 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:37:20.848994 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3 could not be found. Jul 07 10:37:20.848994 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jul 07 10:37:20.848994 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-3146a31a-2341-42f3-912b-f904fc9b4275 tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] Returning 404 to user: Volume 4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:37:20.848994 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-3146a31a-2341-42f3-912b-f904fc9b4275 tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3" status: 404 len: 109 microversion: 2.1 time: 0.034815 Jul 07 10:37:20.848994 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 508/1033] 10.222.0.16 () {58 vars in 1247 bytes} [Thu Jul 7 10:37:20 2022] DELETE /compute/v2.1/os-volumes/4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 07 10:37:20.852566 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-972c32c4-450f-4dd8-b57a-e80ed0b1f6a1 tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] Calling method '.version_select at 0x7f9e9e518940>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:20.878807 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.wsgi [None req-972c32c4-450f-4dd8-b57a-e80ed0b1f6a1 tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] HTTP exception thrown: Volume 4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3 could not be found. Jul 07 10:37:20.880759 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-972c32c4-450f-4dd8-b57a-e80ed0b1f6a1 tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] Request method failure captured: Jul 07 10:37:20.880759 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: request: GET /compute/v2.1/os-volumes/4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3 HTTP/1.1 Jul 07 10:37:20.880759 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept: application/json Jul 07 10:37:20.880759 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Accept-Encoding: identity Jul 07 10:37:20.880759 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Connection: close Jul 07 10:37:20.880759 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Length: 0 Jul 07 10:37:20.880759 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Content-Type: application/json Jul 07 10:37:20.880759 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Host: 10.222.0.16 Jul 07 10:37:20.880759 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Openstack-System-Scope: None Jul 07 10:37:20.880759 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: User-Agent: python-urllib3/1.26.9 Jul 07 10:37:20.880759 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Auth-Token: gAAAAABixrdZIUKuk2SsaJG9VygjGqTYLffbXpXQs-37tK_fdSkNMC2VblqFm7PO8it1cZ-GxruqXZSt8WaMq5abI_wfUTzdfE4fHazsL_a3UMJjPVLfmeEfNiGiBCBWRXiHVsdmbi3tTu_44DXfWpZFMAgrceD71NabuSn93sQPfK68X237EO0 Jul 07 10:37:20.880759 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Id: None Jul 07 10:37:20.880759 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Domain-Name: None Jul 07 10:37:20.880759 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Identity-Status: Confirmed Jul 07 10:37:20.880759 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Is-Admin-Project: True Jul 07 10:37:20.880759 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Id: default Jul 07 10:37:20.880759 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Domain-Name: Default Jul 07 10:37:20.880759 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Id: d81879d0f849442e9f54936c7afb26a2 Jul 07 10:37:20.880759 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-174396199 Jul 07 10:37:20.880759 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Role: member,reader Jul 07 10:37:20.880759 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Roles: member,reader Jul 07 10:37:20.882985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d81879d0f849442e9f54936c7afb26a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d81879d0f849442e9f54936c7afb26a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d81879d0f849442e9f54936c7afb26a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d81879d0f849442e9f54936c7afb26a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 07 10:37:20.882985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant: tempest-VolumesSnapshotsTestJSON-174396199 Jul 07 10:37:20.882985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Id: d81879d0f849442e9f54936c7afb26a2 Jul 07 10:37:20.882985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-174396199 Jul 07 10:37:20.882985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User: tempest-VolumesSnapshotsTestJSON-174396199-project Jul 07 10:37:20.882985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Id: default Jul 07 10:37:20.882985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Domain-Name: Default Jul 07 10:37:20.882985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Id: dfe0c5a416d94ceca62f5bb1f4bdfddf Jul 07 10:37:20.882985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: X-User-Name: tempest-VolumesSnapshotsTestJSON-174396199-project Jul 07 10:37:20.882985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: method: Jul 07 10:37:20.882985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: exception: Volume 4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3 could not be found. Jul 07 10:37:20.882985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: action_args: {'id': '4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3'} Jul 07 10:37:20.882985 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 10:37:20.884002 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:20.884002 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 10:37:20.884002 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 10:37:20.884002 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 10:37:20.884002 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 10:37:20.884002 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 10:37:20.884002 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 10:37:20.884002 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 10:37:20.884002 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 10:37:20.884002 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 10:37:20.884002 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 10:37:20.884002 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 10:37:20.884002 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 10:37:20.884002 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 10:37:20.884002 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 10:37:20.884002 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3 could not be found. (HTTP 404) (Request-ID: req-29f33781-cec1-4e1c-8b6d-2c04394571bf) Jul 07 10:37:20.884002 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:20.884002 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:37:20.884002 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:20.885400 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:20.885400 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 07 10:37:20.885400 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 07 10:37:20.885400 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 10:37:20.885400 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 10:37:20.885400 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 07 10:37:20.885400 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 07 10:37:20.885400 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 10:37:20.885400 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 10:37:20.885400 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 10:37:20.885400 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 10:37:20.885400 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 10:37:20.885400 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 10:37:20.885400 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 10:37:20.885400 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 10:37:20.885400 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 10:37:20.885400 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 10:37:20.885400 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 10:37:20.885400 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 10:37:20.886863 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 10:37:20.886863 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 10:37:20.886863 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 10:37:20.886863 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 10:37:20.886863 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3 could not be found. Jul 07 10:37:20.886863 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:20.886863 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:37:20.886863 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:20.886863 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:20.886863 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:37:20.886863 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:37:20.886863 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 10:37:20.886863 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 10:37:20.886863 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 10:37:20.886863 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 10:37:20.886863 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 10:37:20.886863 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 10:37:20.886863 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 07 10:37:20.886863 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 10:37:20.888459 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3 could not be found. Jul 07 10:37:20.888459 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:20.888459 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 10:37:20.888459 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:20.888459 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 10:37:20.888459 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 10:37:20.888459 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 10:37:20.888459 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 10:37:20.888459 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 10:37:20.888459 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3 could not be found. Jul 07 10:37:20.888459 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: ERROR nova.api.openstack.wsgi Jul 07 10:37:20.888459 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-972c32c4-450f-4dd8-b57a-e80ed0b1f6a1 tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] Returning 404 to user: Volume 4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3 could not be found. {{(pid=117646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 10:37:20.888459 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-972c32c4-450f-4dd8-b57a-e80ed0b1f6a1 tempest-VolumesSnapshotsTestJSON-174396199 tempest-VolumesSnapshotsTestJSON-174396199-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3" status: 404 len: 109 microversion: 2.1 time: 0.033919 Jul 07 10:37:20.888459 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 526/1034] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jul 7 10:37:20 2022] GET /compute/v2.1/os-volumes/4e65bdd7-8902-4aa7-925a-a36d0ba5f1e3 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 10:37:23.536002 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4e6cfa31-9d91-458c-9862-7da7d81fa300 tempest-VolumesTestJSON-1282609329 tempest-VolumesTestJSON-1282609329-project] Calling method '.version_select at 0x7f9e9e303700>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:23.581619 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-4e6cfa31-9d91-458c-9862-7da7d81fa300 tempest-VolumesTestJSON-1282609329 tempest-VolumesTestJSON-1282609329-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9972e1b9-8751-4ad7-92c0-9d4dc7e90523" status: 200 len: 350 microversion: 2.1 time: 0.050377 Jul 07 10:37:23.582173 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 509/1035] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jul 7 10:37:23 2022] GET /compute/v2.1/os-volumes/9972e1b9-8751-4ad7-92c0-9d4dc7e90523 => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:37:24.890753 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-7d4548e1-1aef-4361-91d3-d96079fb16bd tempest-VolumesTestJSON-1282609329 tempest-VolumesTestJSON-1282609329-project] Calling method '.version_select at 0x7f9e9e3658b0>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:24.936015 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-7d4548e1-1aef-4361-91d3-d96079fb16bd tempest-VolumesTestJSON-1282609329 tempest-VolumesTestJSON-1282609329-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/a9eecddf-8982-493d-9358-40b7c3cf1a5c" status: 200 len: 351 microversion: 2.1 time: 0.051750 Jul 07 10:37:24.936683 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 527/1036] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jul 7 10:37:24 2022] GET /compute/v2.1/os-volumes/a9eecddf-8982-493d-9358-40b7c3cf1a5c => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:37:26.248098 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-bdb71170-029f-44e4-abd6-527387faf540 tempest-VolumesTestJSON-1282609329 tempest-VolumesTestJSON-1282609329-project] Calling method '.version_select at 0x7f9e9e6a3790>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:26.293473 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-bdb71170-029f-44e4-abd6-527387faf540 tempest-VolumesTestJSON-1282609329 tempest-VolumesTestJSON-1282609329-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/1225a14c-05a0-4752-b5d2-318145b784d5" status: 200 len: 351 microversion: 2.1 time: 0.049610 Jul 07 10:37:26.294037 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 510/1037] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jul 7 10:37:26 2022] GET /compute/v2.1/os-volumes/1225a14c-05a0-4752-b5d2-318145b784d5 => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:37:26.305690 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-39e3d0a3-c5df-40fb-b3b4-9231ffa0f12c tempest-VolumesTestJSON-1282609329 tempest-VolumesTestJSON-1282609329-project] Calling method '.version_select at 0x7f9e9e518e50>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:26.384703 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-39e3d0a3-c5df-40fb-b3b4-9231ffa0f12c tempest-VolumesTestJSON-1282609329 tempest-VolumesTestJSON-1282609329-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.083368 Jul 07 10:37:26.385464 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 528/1038] 10.222.0.16 () {58 vars in 1133 bytes} [Thu Jul 7 10:37:26 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:37:26.397212 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-76d9be15-cb04-4d84-a486-35839b04345f tempest-VolumesTestJSON-1282609329 tempest-VolumesTestJSON-1282609329-project] Calling method '.version_select at 0x7f9e9e47b790>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:26.477446 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-76d9be15-cb04-4d84-a486-35839b04345f tempest-VolumesTestJSON-1282609329 tempest-VolumesTestJSON-1282609329-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.083917 Jul 07 10:37:26.478042 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 511/1039] 10.222.0.16 () {58 vars in 1148 bytes} [Thu Jul 7 10:37:26 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:37:26.489742 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-383bee20-b79f-4a7c-b352-35957f6ec9a6 tempest-VolumesTestJSON-1282609329 tempest-VolumesTestJSON-1282609329-project] Calling method '.version_select at 0x7f9e9e3dd3a0>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:26.567983 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-383bee20-b79f-4a7c-b352-35957f6ec9a6 tempest-VolumesTestJSON-1282609329 tempest-VolumesTestJSON-1282609329-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.081991 Jul 07 10:37:26.568558 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 529/1040] 10.222.0.16 () {58 vars in 1133 bytes} [Thu Jul 7 10:37:26 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:37:26.580129 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-db1cc155-4467-4bfa-a9ac-d3f68ca0b1c7 tempest-VolumesTestJSON-1282609329 tempest-VolumesTestJSON-1282609329-project] Calling method '.version_select at 0x7f9e9e317280>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:26.659006 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-db1cc155-4467-4bfa-a9ac-d3f68ca0b1c7 tempest-VolumesTestJSON-1282609329 tempest-VolumesTestJSON-1282609329-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.082556 Jul 07 10:37:26.659581 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 512/1041] 10.222.0.16 () {58 vars in 1166 bytes} [Thu Jul 7 10:37:26 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:37:26.671032 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-adc3492b-a321-46fe-b281-882733257ee4 tempest-VolumesTestJSON-1282609329 tempest-VolumesTestJSON-1282609329-project] Calling method '.version_select at 0x7f9e9e516b80>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:26.751795 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-adc3492b-a321-46fe-b281-882733257ee4 tempest-VolumesTestJSON-1282609329 tempest-VolumesTestJSON-1282609329-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.084399 Jul 07 10:37:26.752371 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 530/1042] 10.222.0.16 () {58 vars in 1169 bytes} [Thu Jul 7 10:37:26 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:37:26.764613 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-087d3d25-2c23-4eab-88e4-3f520e5cc406 tempest-VolumesTestJSON-1282609329 tempest-VolumesTestJSON-1282609329-project] Calling method '.version_select at 0x7f9e9e2bc040>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:26.842204 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-087d3d25-2c23-4eab-88e4-3f520e5cc406 tempest-VolumesTestJSON-1282609329 tempest-VolumesTestJSON-1282609329-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.081296 Jul 07 10:37:26.842779 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 513/1043] 10.222.0.16 () {58 vars in 1154 bytes} [Thu Jul 7 10:37:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:37:26.854289 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: DEBUG nova.api.openstack.wsgi [None req-ce1f18b9-d454-4951-805e-379615216dce tempest-VolumesTestJSON-1282609329 tempest-VolumesTestJSON-1282609329-project] Calling method '.version_select at 0x7f9e9e516310>' {{(pid=117646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:26.933489 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO nova.api.openstack.requestlog [None req-ce1f18b9-d454-4951-805e-379615216dce tempest-VolumesTestJSON-1282609329 tempest-VolumesTestJSON-1282609329-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.083382 Jul 07 10:37:26.934062 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: [pid: 117646|app: 0|req: 531/1044] 10.222.0.16 () {58 vars in 1187 bytes} [Thu Jul 7 10:37:26 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 10:37:26.945789 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-86d9e1bc-e596-4b10-918c-30c2b2ea5213 tempest-VolumesTestJSON-1282609329 tempest-VolumesTestJSON-1282609329-project] Calling method '.version_select at 0x7f9e9e45e160>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 10:37:27.026697 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-86d9e1bc-e596-4b10-918c-30c2b2ea5213 tempest-VolumesTestJSON-1282609329 tempest-VolumesTestJSON-1282609329-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084995 Jul 07 10:37:27.027359 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 514/1045] 10.222.0.16 () {58 vars in 1154 bytes} [Thu Jul 7 10:37:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 10:39:15.156021 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 10:39:15.156609 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Thu Jul 7 10:39:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 10:39:37.797586 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 10:39:37.797586 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Thu Jul 7 10:39:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 10:39:40.798740 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 10:39:40.799298 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Thu Jul 7 10:39:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 10:41:05.978376 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 10:41:05.979516 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Thu Jul 7 10:41:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 10:41:09.753809 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 10:41:09.754275 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Thu Jul 7 10:41:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 10:42:35.164248 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 10:42:35.164877 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Thu Jul 7 10:42:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 10:42:39.579552 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 10:42:39.580159 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Thu Jul 7 10:42:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 10:42:57.806161 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 10:42:57.807115 dv-cinder-822821-4-iscsi devstack@n-api.service[117647]: Thu Jul 7 10:42:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 10:43:00.808268 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 10:43:00.808806 dv-cinder-822821-4-iscsi devstack@n-api.service[117646]: Thu Jul 7 10:43:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!